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ABSTRACT 



Elack undergraduates at the University of Maryland, 
College Park who registered for the fall 1969 term, but not for the 
spring 1970 term were compared with Blacks who registered for both 
terms on 29 demographic and attitudinal items from the University 
Student Census. Thirteen percent of the Blacks were non-returnees, 
compared to 15 percent of all undergraduates,. The results indicated 
that the Blacks who returned to their studies at the University have 
more self-confidence and higher expectations, feel more strongly that 
the University, and are more likely to live on campus and make use of 
its facilities than do non- re turning Blacks. In other words, it is 
likely that the Blacks who stay in school have a strong self-concept 
and take a mere realistic lcck at the University and adapt to it to 
achieve their cwn goals. (Author/AE) 
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Glenwood C. Brooks, Jr. 

Research Report # 4-70 

SUMMARY 

Black undergraduates at the University of Maryland, College Park who 
registered for the fall 1969 term and who did not register for the spring 
1970 term were compared with Blacks who did register for both terms on 29 
demographic and attitudinal items from the University Student Census (USC) . 
Thirteen percent of the Blacks were non-returnees, compared to 15% of all 
undergraduates. Results indicated that the Blacks who return to their studies 
at the University have more self confidence and higher expectations (Tables 
4 and 5), feel more strongly that the University should influence social con- 
ditions (item 34, page 5), see more racism at the University (Table 3) and 
are more likely to live on campus and make use of its facilities (Table 2 
and item 42, page 5), than do non-returning B/acks. 

In other words, it could be that the Blacks who stay in school have a 
strong self concept and take a more realistic look at the University and 
adapt to it to achieve their own goals.. The importance of such variables 
has been noted by several other writers. 
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Despite the publicity and the apparent interest of the predominantly' 
white universities in enrolling Black students, very few Blacks are enter- 
ing these schools. In the fall of 1 969 the median percent of Black Preshmen 
in large, predominantly white institutions nationally was 3% (Sedlacek and 
Brooks, 1970) > Given that there are few Blacks in attendance at such schools, 
what variables are related to Blacks staying in these institutions? Evidence 
is virtually unavailable on this point. Generally there is a shortage of data 
available on variables associated with the success or failure of Black students. 
Katz (1969, p. 23) summarized it as follows: “Psychologists have contributed 

little to the understanding of the motivational problems of disadvantaged 
students. Scientific knowledge has barely advanced beyond the conventional 
wisdom of the teachers 1 lounge. In a sense, so few good data are available 
that virtually any competent foray into the area is bound to be fruitful." 

It is the purpose of this study to provide some data in this area. 

The prediction of collegiate performance and attrition of students in 
general has been the subject of extensive research in the past. Despite 
this fact, it has been observed (Travers, 1949* and Stein, 1963) that there 
has been little increase in the effectiveness of prediction since 1940. To 
meet this need for more predictive effectiveness, the direction of research 
has moved into the area of socioeconomic and nonintellectual variables as 
predictors of collegiate performance and attrition (Summerski 1 1 , 1962; Stein, 
1963; Atkinson, 1964; Katz, 1964; Pettigrew, 1964; Pervin, Reik, and Dalrymple, 
1966; Cope, 1968; and Reed, 1968). 

The present study developed from an interest in relating some of these 
non-i ntel lectuai and socioeconomic factors to Black student attrition. For 
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purposes of this study, "returnees" will be defined as those Black students 
at the University of Maryland (College Park) who registered for both the Fall 
1969 and Spring 1970 semester. "Non-returnees" are those Black students who 
registered for the Fall 1969 semester but not for the Spring 1970 semester at 
the Uni versi ty (excluding graduates in January, 1970). 

Specifically, the purpose of this study is to explore the ways, if any, 
in which Black returning students are different from those not returning, on 
demographic and attitudinal variables. 



Method 

Data for this study were collected from the University Student Census* 

(USC) that was administered to nearly all full-time undergraduate students (9 
credits or more) registering for the Fall 1969 semester. T he sample used in 
this research was limited to all full-time Black undergraduate students who 
registered for the 1 969~ 70 Fall and Spring semesters, and who completed the USC. 
The sample consisted of 500 Black students from a total of 582 Black under- 
graduates. Of the 82 students not included in the study, it is estimated that 
about 80 percent registered late and therefore did not take the USC. The 
research sample of 500 was divided into five student status groups: (1) New 

freshmen; (2) New transfer students; (3) Transfer students in an earlier 
semester; (4) Started as a new freshman at College Park in an earlier semester; 
and (5) An "other" category. A percentage breakdown on these five categories 
of student status by sex is given in Table I. 

Differences among groups on the first twenty-nine USC items were deter- 
mined using chi-square. On the last 17 USC questions, the subjects were asked 
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to indicate the extent to which they agreed with certain statements on a 
five point scale and t-tests were employed to determine significance. 
Comparisons were made of returnees and non- returnees by total group and within 
sex. 



Results 

A significant chi-square (.05 level) was found on only four of the first 
twenty-nine USC questions (see Tables 2 through 5). With the exception of 
these four questions, a great deal of similarity existed between returnees 
and non-returnees. 

The first USC* item of significance was number k: the amount of impact 

tne Student Course Guide* had upon the student's course selection. There was 
a significant difference found at the .05 level when all returnees were com- 
pared to all non-returnees and when female returnees were compared to female 
non-returnees (see Table 2). The greatest difference indicated in Table 2 
is that while only 19% of the returning students declared the Student Course 
Guide had no impact upon their course selection, 3^% of all non-returnees 
felt it had no impact. Although results were not significant, differences 
between male returnees and non-returnees were similar to those for the first 
two comparisons ( i . e . , for the no impact reponse, 18% of male returnees as 
opposed to 31% of the male non-returnees). 

USC item 10, which asks the student why he feels there are few Black 
students at the University of Maryland, had a significant chi-square beyond 
the .05 level for all returnees vs. all non-returnees (see Table 3). Returnees 
felt more (67%) that racism was the reason Blacks did not attend the University 

* The Student Course Guide is an evaluation of courses and instructors 
prepared by students. 
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compared to 47% of the non-returnees. 

A significant difference beyond the .05 level was found on item 16 for 
the female returnees versus non-returnees (see Table 4). This item asks the 
student how much education he expects to get in his lifetime. The possible 
responses were combined to give results indicating: college but less than a 

bachelor's degree; a BA or equivalent; or one or more years of graduate work. 

In percentage terms, the most striking difference between female returnees and 
non-returnees was that 56 % of the non-returnees expected to get a BA or less, 
and only 32 % of the returnees made this response . In addition, while 35% of 
the female non- returnees indicated that they expected to complete one or more 
years of graduate school, 62 % of the female returnees made this response. 

The chi-square on USC item 21 showed a significant difference beyond .05 
for all returnees versus all non-returnees; and for female returnees versus 
female non-returnees (see Table 5). This item is concerned with the most likel 
reason for the student's leaving before earning a degree. The most notable 
response difference was to the option "Absolutely certain I will obtain a 
degree;" 23% of all returning students (as opposed to 9% of all non-returning) 
gave this reply. Nineteen percent of the female returnees said they were 
absolutely certain of obtaining a degree; while only 5% of the female non- 
returnees made this choice. 

On item 23 of the USC, the respondent is asked where he wi 1 1 live during 
that semester. Of the possible answers, 49% of the female returnees indicated 
that they would be living in a University residence hali. compared to 26 % of 
the female non-returnees. 

None of the comparisons between male returnees and male non-returnees 
on any of the first 29 USC items was significant. 
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The results of t-tests for all groups tested on the final seventeen 
items were in general not significant. However, four comparisons out of 
the total were significant beyond the .05 level. Item 34, which states 
that the University should use its influence to improve social conditions 
in the State, was found to be significant beyond the .05 level for all three 
group combinations. In each case, returnees were more In agreement with the 
statement than non-returnees. For item 42, the data suggest that female return- 
ees felt more strongly than female non-returnees that many facilities and \ 

opportunities exist on campus for individual creative activities (.05 level). 

Di scuss i on 

It was hypothesized that significant differences would be found between 
returning and non-returning Black students on a number of demographic and 
attitudinal variables. Generally returnees and non-returnees appeared similar 
on the variables examined in this study. However, there were some interesting 
differences between the two groups. 

The picture which emerges is that the Blacks who returned to their 
studies at the University have more self confidence and higher expectations 
(Tables 4 & 5) , feel more strongly that the University should influence social 
conditions (item 34, page 5), see more racism at the University (Table 3) and 
are more likely to live on campus and make use of its facilities (Table 2, and 
item 42, page 5) than do non-returning Blacks. 

In other words, it could be that th~ Blacks who stay in school have a 
strong self concept and take a more realistic look at the University and adapt 
to it to achieve their own goals. The importance of such variables has been 
noticed by several other writers. Pfeifer and Sedlacek (1970) found that 
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self concept was an important variable in the success of Black students at 
the University of Maryland using grades as a criterion. Epps (1969) and 
Gurin, Lao and Beattie (1969) found that successful Black students tended to 
have high aspirations and feel that they had control over their lives. 

The attrition figures for Blacks in this study (non-returnees, Spring 
semester) were 13% overall (10% males and 16% females). These figures com- 
pare with about 15%* for all College Park undergraduates in 1969 (non-return- 
ees, Spring semester)*. 

Several potential limitations of the study should be noted. Of course, 
the sample was drawn from a single university and only one definition of 
attrition was used. It may be that the results would be different in other 
samples or with different definitions of attrition (e.g. students leaving 
after a year or more, or those with low grades). However, students who leave 
in midyear may be an important group to examine; they may be more likely to have 
problems in adjusting to the University (e.g. expecting less racism than they 
found) and it may be possible to help or work with such students or, even 
better, to eliminate racism at the University. 

Another methodological point is that the number of comparisons made 
increases the chances of a Type 1 error. This was not considered a major 
problem since the purpose of the study was to identify variables which de- 
served further study. Thus this study should be replicated and further 
refined. 

* Source: Office of Institutional Research, University of Maryland. 
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Table 1. 

Percentage Distribution of Black Students by Class 
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?t percentages may not equal 100 because of rounding. 



Percentage Response* for Black Students to Item 4 of the University Student Census 
(What impact has the Student Course Guide had on your course selection?) 
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(Significant differences beyond .05 using X Z are AxB and CxD) 



Percentage Response* for Black Students to Item 10 of the University Student Census 
(What is the main reason you feel there are few Black students at the University of Maryland?) 
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Percentage Response* for Black Students to Item 16 of the University Student Census 
(How much education do you expect to get in your lifetime?) 
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TOTAL** 100% 101% 100% 10]% 100% 101% 

*(Significant difference beyond .05 using X* is CxD) 

** All totals do not equal 100 due to rounding. 



Percentage Response* for Black Students to Item 21 of the University Student Census 
(if you should leave the University without receiving a degree, which of the following 
do you think would be the most likely cause?) 
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* (Significant differences beyond .05 using are AxB and CxD) 
** All totals do not equal 100 due to rounding . 
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of the above areas making a total of 105 items. Appendix A groups the goal 
statements under the above goal areas. 

For each goal statement, the respondent checked the degree of importance 
for the institution on a five point scale ("of extremely high importance", "of 
high importance", "of medium importance", "of low importance", "of no impor- 
tance"). All groups responded to the goal statements both in terms of perceived 
existing goals and in terms of beliefs about what the institution's aims 
ought to be. 

In general, on-campus groups responded with reference to their institu- 
tion, while off-campus groups responded with reference to the local institu- 
tion being rated. The directions for completing the instrument and providing 
feedback to the participants were modified to meet the specific objectives 
of each administration of the questionnaire. 

Review of the Delphi Technique 

The Delphi technique is a procedure originally developed by the RAND 
Corporation for obtaining greater consensus among experts about urgent defense 
problems without face-to-face discussion. Of course, face-to-face discussion 
is the usual procedure for combining individual opinions. However, for some 
time it has been known that there are serious problems associated with this 
mode of communication (Kelley and Thibaut, 1954). Some examples of these 
problems follow. 1. Group opinion is highly influenced by dominant individ- 
uals who usually talk the most. Yet, there is very little correlation between 
pressure of speech and knowledge. 2. Much discussion in group situations, 
while sometimes appearing to be problem oriented, is often irrelevant or biasing 
because in many instances it is usually concerned with individual and group 

interests rather than with problem-solving. 3. Group pressure to conform 
can distort individual judgment as demonstrated by Asch (1958). 

O 
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Thus it is not very surprising that the RAND Corporation found, using 
almanac-type questions, that "after face-to-face discussion, more often than 
not the group response is less accurate than a simple median of individual 
estimates without discussion" (Daikey, 1969) . 

The objective of the Delphi technique is to obtain consensus of opinions 
without bringing the experts together in a face-to-face meeting; this is 
achieved by having them complete a series of questionnaires interspersed 
with controlled opinion feedback. Not only can this mean a savings in time 
and money, but also, and more importantly for this study, this mode of 
controlled interaction among the respondents is considered necessary for 
independent thought on the part of the participants and helpful to them in 
the gradual formation of a considered opinion. In addition it has the added 
advantage of providing anonymity to the participants. This is in contrast 
to direct confrontation as in a faculty meeting which in too many instances 
causes hasty formulation of preconceived notions, an inclination to close one's 
mind to novel ideas, a tendency to defend a previously taken stand, or a 
tendency to be influenced by persuasively stated opinions of othei'S . 

The general procedure for the Delphi technique is as follows: (1) the 

participants are asked to list their opinions on a specific topic, such as 
scientific predictions or recommended activities; (2) the participants are 
then asked to evaluate the total list by a criterion, such as importance, 
chance of success, etc.; (3) each participant receives the list and a summary 
of responses to the items and, if in the minority, is asked to revise his 
opinion or indicate his reason for remaining in the minority; and (4) each 
participant again receives the list, an updated summary, minority opinions, 
and a final chance to revise his opinions. 
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A number of studies employing the Delphi technique have been performed 
by the RAND Corporation. One example was its use in conducting an extensive 
survey on predicted long-range developments, some as far as fifty years into 
the future, in such areas as scientific breakthroughs, population growth, 
automation, space progress, probability and prevention of war, and future 
weapon systems (Gordon and Helmar, 1966) . A summary of responses from each 
round of questionnaires was fed back to the respondents before they replied 
to each succeeding round of questionnaires. Results using the Delphi technique 
indicated a number of areas of interest: the contents of the predictions 

themselves, the bases on which respondents claimed their predictions were 
made, the spread of experts 1 views, the consistent convergence of views 
following data feedback, and the experts’ critiques of one another’s views. 

Another study using the Delphi technique was reported by Pfeiffer (1968) 
and was not coLJemed with long-range predictions but with developments in 
the near future. Thus the accuracy of the predictions could be verified. 

In this study conducted at U, C. L. A. in 1965, 20 students forecasted 16 
business indexes, such as gross national product, defense expenditures, etc., 
using the Delphi technique. Another twenty students filled out non -Delphi 
questionnaires, asking for forecasts only. Of the two groups, the Delphi 
students’ predictions were more accurate for 14 of the items, the non-Delphi 
group did better on two items, and in one case both groups made the same 
prediction. Thus the Delphi technique was not only successful in obtaining 
a consensus on many items, and at least a majority opinion and a clearly 
defined minority opinion on others, but also produced more accurate responses. 

The RAND Corporation (Daikey, 1969) has also conducted some studies 
comparing face-to-face discussion with the controlled-feedback interaction of 
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the Delphi technique using almanac-type questions. Dalkey reports: . .more 

often than not, face-to-face discussion tended to make the group estimates 
less accurate, whereas, more often than not, the anonymous controlled feed- 
back procedure made the group estimates more accurate" (Dalkey, 1969). 

Some recent applications of the technique have been made in the area of 
education. Cyphert and Gant (1971) used the technique to assist in identi- 
fying goals for the School of Education at the University of Virginia. Anderson 
(1970) assisted a county school district in identifying its goals by the 
Delphi technique while Norton (1970) assisted in identifying the needs for 
a newly planned university. Judd (1970) reports that through the use of the 
Delphi technique, a highly innovative and experimental type of curricula 
program was adopted by an extremely conservative faculty. 

A bibliography of research publications concerning the Delphi technique 
is included in Appendix G. 

Method 



!, 
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Since the procedure employed in this study was rather complex, only a 
general description is presented below to give the reader an overview of the 
project. For those desiring greater detail and to satisfy the objective of 
providing documentation for the replication of this study. Appendix E presents 
chronologically the steps employed in the study. 

Five institutions were selected by ETS and RELCV from the Southeast to 
represent institutions which differed on the following dimensions: public 

vs. private, college vs. university, large vs. small, and predominantly 
Caucasian vs. predominantly Negro. A description of each of these five in- 
stitutions is included in Appendix D. 



ISB'J 



Representatives of the following on-campus and off-campus groups were 
included: students selected using stratified random sampling in order that, 

whenever possible, a male and female were included from each department; 
faculty selected using stratified random sampling in order that, whenever 
possible, each departmentwas represented; all academic administrators; a sample 
of active trustees selected by the institution; a sample of active alumni 
selected by the institution; at two institutions, parents of the students 
included; and leaders of different community groups, such as local political, 
occupational, religious, and minority groups, as well as the community mayor 
and newspaper editors. 

The development of the goals instrument itself was a separate ETS project 
and is described in the Background section of this report. It was a result 
of ETS's continuing developmental work toward an Institutional Goals Inventory 
(IGI). 

Instructions to accompany the preliminary form of the IGI used in this 
study were developed to adapt the instrument to the Delphi procedure. These 
different instructions accompanied each administration of the IGI and are 
included in Appendix C. 

The general procedure for the Delphi technique is as follows: 

1. the participants are asked to list their opinions on a specific 
topic, such as scientific predictions or recommended activities; 

2. the participants are then asked to evaluate the total list by a 
criterion, such as importance, chance of success, etc.; 

3. each participant receives the list and a summary of responses to the 
items and, if in the minority, is asked to revise his opinion or 
indicate his reason for remaining in the minority; and 
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4, each participant again receives the list, an updated summary, minority 
opinions, and a final chance to revise his opinions. 

In this study, step 1 was omitted; the participants were not asked to 
list their opinions as to what goal statements should be included in the study. 
Instead, the preliminary form of the Institutional Goals Inventory, previously 
described, was used. With almost 1000 participants, step 1 was considered 
impraccical. Step 2 involved sending the questionnaire at the beginning of 
March, 1970, and asking each participant to check the degree of importance of 
each goal statement both in terms of perceived existing goals (How important 
is the goal at this institution at the present time? Consider the institution 
as a whole in making your judgment.) and in terms of beliefs about what the 
institution's goals ought to be_ (In your judgment, how important should the 
goal be at this institution?). Space for comments was provided for each 
goal statement in order that a participant who was having difficulty with a 
particular statement could make the problem known to the researcher. In 
addition, space was provided at the end of the instrument for any participant 
to add and rate goals which he felt had not been covered. Nine hundred eighty- 
nine questionnaires were sent to members of the different groups described 
earlier with instructions to return the completed questionnaire within five 
days. The data from each institution were analyzed separately to determine 
the two modal responses per goal statement, one for the "is 11 rating, the other 
for the "should be" rating. These modal responses were used in the third step 
of the Delphi technique (the second step in this project) „ 

According to the third step of the general Delphi procedure, each partic- 
ipant receives the list of items and a summary of responses to the items and, 
if in the minority, is asked to revise his opinion or indicate his reason 
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for remaining in the minority. With one modification, this was the objective 
of the second questionnaire which was delivered at the beginning of April 
to each participant. The second questionnaire was similar to the first except 
that the response block associated with the modal category of importance was 
circled in red. If the number of responses to another category of importance 
did not differ by more than 10% from the number of responses to the modal 
category, that category was also circled in red. However, in contrast to the 
normal Delphi procedure, the participant's previous response was not indicated. 
Emphasizing a participant's previous response, especially when it differed 
from the most frequent response, could make some participants defensive. It 
was the author's opinion that a person should not have to defend a position 
unless he felt strongly about it. Thus, the instructions to participants 
indicated that they were not to be concerned with the responses they made 
to the previous questionnaire. They were being given an indication of how 
others responded and, if the category they now selected differed from the most 
frequently selected category, they were to indicate, if possible, one or two 
important reasons for their choice. These questionnaires were sent to the 
same people who received the first questionnaire. From the returned question- 
naires, the modal item responses were again calculated for each institution 
as from the first questionnaire. In addition, for each institution, reasons 
indicating a degree of importance different from the modal response were 
summarized. These reasons were not only summarized for each "is" and "should 
be" statement, but also by the categories "more important than most frequent 
response" and "less important than most frequent response." These modal 
responses and summaries of minority views were used in the fourth step of 
the Delphi technique (the third step for this project). 
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In the fourth step of the Delphi procedure, each participant should 
again receive the list of items, an updated summary of minority opinions, 
and a final chance to revise his opinions. This was the objective of the 
third questionnaire which was received by the participants at the beginning 
of May. The modal response was circled in red as in the second question- 
naire. In addition, accompanying each questionnaire was a separate summary 
of minority opinions for the specific institution. These were prepared to 
line up readily with the appropriate goal statement. Only minority opinions 
cited by at least two people were included in this summary. After reading 
the goal statement the participant was to notice the most frequently checked 
category of importance (circled in red), and then read the reasons why some 
people thought the goal more important and why some thought it less important. 
After considering these reasons, he was to indicate his opinion by checking 
one of the categories of importance:. For example, a participant was asked 
to read a goal statement such as !, to help formulate programs in a number of 
public policy areas such as pollution control, urban renewal, and health 
care." He would notice that "of low importance" had been the most frequently 
chosen category to represent how important the goal presently is. He would 
also read that some participants had thought it should be rated of greater 
importance because "it was being done in some curricula, for example, environ- 
ment and conservation curricula." Participants who had thought it should be 
rated of lesser importance than the most frequent response gave as one reason 
"very little was being done in this area." After noting the most frequently 
selected category and reading the minority views of both sides, the partici- 
pant indicated his opinion by checking one of the categories. 

The previous paragraphs describe how this study employed the procedures 
of the Delphi technique to help identify an institution's goals. An additional 
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step was included in the study which was not part of the Delphi technique. 

On the last questionnaire participants were asked to indicate on a high-low 
priority continuum those goal statements which they had indicated should be 
"of extremely high importance." The object of this step was to provide better 
discrimination among those goals which were of greatest preferred importance 
to the respondent. Other researchers (e.g., Gross and Grambsch) have found 
that the standard Likert scale does not always provide adequate discrimina- 
tion in the most important category. 

In order to provide participating institutions with their results, a 
report was prepared for each institution which included the following results: 

1. The number of participants completing the questionnaires by group 

2. A profile of the present and preferred importance given to each 
goal area 

3. A comparison of their present and preferred profiles with 
those of the other participating institutions. 

4. The mean and standard deviation of the present and preferred 
importance of each goal area and of each goal statement by 
response group and by all respondents for each questionnaire 

5. A ranking of goal areas and goal statements according to their 
present and preferred importance by response group and by all 
respondents 

6. A ranking of goal areas and goal statements according to the 
magnitude of discrepancy between present and preferred importance 
by response group and by all respondents 

7. A plot indicating each group’s mean importance rating by question 
naire for each goal area. These plots visually illustrate the 
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amount of convergence occurring among the groups for each goal 
area. 

The same analyses were performed for all institutions combined. 

The results were disseminated to each institution in the following way. 
The project director met with the liaison person on each campus to discuss 
the above results and provided him with a copy of the results to discuss 
with his president and others on his campus. After about two weeks, a team^ 
composed of the project director, members of ETS and RELCV, and a consultant 
met with the president and other members of the institution for a half day to 
discuss the results.^ 



Results and Discussion 



This section is divided into five areas: (1) Percent of Questionnaires 

Returned; (2) Reliability Estimates of Goal Areas; (3) Institution and 
Group Comparisons; (4) Evaluation of the Institutional Goals Inventory (IGI); 
and (5) Evaluation of the Delphi Technique. 

Percent of Questionnaires Returned 

The number of questionnaires originally sent and the number and percent 
returned by each participating group for all schools is given in Table 1. 
Identical information for each participating institution is given in Tables 
2 through 6. 



^Members of the team were; Earl McGrath, consultant; Harry Blanton, James 
Dobbins, Ed Hobson, Oscar Mink, and Philip Winstead from RELCV; and Eldon 
Park, Richard Peterson, and Norman Uhl, from ETS. 

SRELCV has developed a series of workshops to integrate the results of this 
study with their Administrative-Organizational Systems. 
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TABLE 1 ALL INSTITUTIONS 

NUMBER OF QUESTIONNAIRES ORIGINALLY 
SENT AND THE NUMBER AND 
PERCENT RETURNED 



Participant Group 


Originally 

Sent 




Ql 


Returned 

Q2 




Q3 


Administrators 


161 


148 


(92%) 


135 


(84%) 


132 


(82%) 


Alumni 


49 


37 


(76%) 


27 


(55%) 


28 


(57%) 


Community 


155 


93 


(60%) 


73 


(47%) 


67 


(43%) 


Faculty 


148 


132 


(89%) 


120 


(81%) 


108 


(73%) 


Students 


326 


316 


(97%) 


308 


(94%) 


305 


(94%) 


Tinas tees 


34 


27 


(79%) 


22 


(65%) 


23 


(68%) 


Parents 


103 


83 


(81%) 


78 


(76%) 


69 


(67%) 


Advisory Council 


13 


8 


(62%) 


8 


(62%) 


9 


(69%) 


Total 


989 


844 


(85%) 


771 


(78%) 


741 


(75%) 



ERIC 
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TABLE 2 



INSTITUTION 1 



NUMBER OF QUESTIONNAIRES ORIGINALLY 
SENT AND THE NUMBER AND 
PERCENT RETURNED 



Participant Group 


Originally 
. Sent 




Qi 


Returned 

Q2 




Q3 


Administrators 


31 


29 


(94%) 


27 


(87%) 


27 


(87%) 


Alumni 


11 


10 


(91%) 


8 


(73%) 


8 


(73%) 


Community 


46 


29 


(63%) 


23 


(50%) 


21 


(46%) 


Faculty 


27 


25 


(93%) 


24 


(89%) 


22 


(81%) 


Students 


57 


55 


(96%) 


55 


(96%) 


56 


(98%) 


Trustees 


12 


10 


(83%) 


8 


(67%) 


10 


(83%) 


Parents 


55 


45 


(82%) 


40 


(73%) 


32 


(58%) 


Advisory Council 


13 


8 


(62%) 


8 


(62%) 


9 


(69%) 


Total 


252 


211 


(84%) 


193 


(77%) 


185 


(73%) 



TABLE 3 INSTITUTION 2 

NUMBER OF QUESTIONNAIRES ORIGINALLY 
SENT AND THE NUMBER AND 
PERCENT RETURNED 



Originally Returned 



Participant Group 


Sent 




Ql 




Q2 




Q3 


Administrators 


23 


19 


(83%) 


20 


(87%) 


18 


(78%) 


Alumni 


6 


4 


(67%) 


2 


(33%) 


3 


(50%) 


Community 


40 


20 


(50%) 


17 


(43%) 


17 


(43%) 


Faculty 


25 


21 


(84%) 


19 


(76%) 


18 


(72%) 


Students 


54 


51 


(94%) 


50 


(93%) 


51 


(94%) 


Trustees 


5 


5 


(100%) 


4 


(80%) 


4 


(80%) 


Total 


153 


120 


(78%) 


112 


(73%) 


111 


(73%) 
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INSTITUTION 3 



NUMBER OF QUESTIONNAIRES ORIGINALLY 
SENT AND THE NUMBER AND 
PERCENT RETURNED 



Originally Returned 



Participant Group 


Sent 




Ql 




Q2 




Q3 


Administrators 


28 


25 


C89%) 


17 


(61%) 


17 


(61%) 


Alumni 


14 


11 


(79%) 


8 


(57%) 


7 


(50%) 


Community 


39 


27 


(69%) 


20 


(51%) 


17 


(44%) 


Faculty 


26 


21 


(81%) 


19 


(73%) 


17 


(65%) 


Students 


55 


52 


(95%) 


48 


(87%) 


49 


(89%) 


Trustees 


6 


4 


(67%) 


4 


(67%) 


3 


(50%) 


Total 


168 


140 


(83%) 


116 


(69%) 


110 


(65%) 



TABLE 5 INSTITUTION 4 



NUMBER OF QUESTIONNAIRES ORIGINALLY 
SENT AND THE NUMBER AND 
PERCENT RETURNED 



Originally Returned 



Participant Group 


Sent 




Ql 




Q2 




Q3 


Admini s t r a t or s 


42 


40 


(95%) 


40 


(95%) 


38 


(90%) 


Alumni 


9 


6 


(67%) 


5 


(56%) 


5 


(56%) 


Community 


14 


5 


(36%) 


4 


(29%) 


3 


(21%) 


Faculty 


45 


43 


(96%) 


38 


(84%) 


35 


(78%) 


Students 


106 


104 


(98%) 


104 


(98%) 


98 


(92%) 


Trustees 


6 


3 


(50%) 


1 


(17%) 


2 


(33%) 


Total 


222 


201 


(91%) 


192 


(86%) 


181 


(82%) 



0 

ERIC 



TABLE 6 



INSTITUTION 5 



NUMBER OF QUESTIONNAIRES ORIGINALLY 
SENT AND THE NUMBER AND 
PERCENT RETURNED 



Originally Returned 



Participant Group 


Sent 




Q1 




Q2 




Q3 


Admini st rat ors 


37 


35 


(95%) 


31 


(84%) 


32 


(86%) 


Alumni 


9 


6 


(67%) 


4 


(44%) 


5 


(56%) 


Community 


16 


12 


(75%) 


9 


(56%) 


9 


(56%) 


Faculty 


25 


22 


(88%) 


20 


(80%) 


16 


(64%) 


Students 


54 


54 


(100%) 


51 


(94%) 


51 


(94%) 


Trustees 


5 


5 


(100%) 


5 


(100%) 


4 


(80%) 


Parents 


48 


38 


(79%) 


38 


(79%) 


37 


(77%) 


Total 


194 


' 172 


(89%) 


158 


(81%) 


154 


(79%) 



0 

ERIC 
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The percent of questionnaires returned is very high for this type of 
study; of the 989 people receiving them, 844 or 85% answered and returned 
the first, 771 or 78% answered and returned the second, and 741 or 75% 
answered and returned the third questionnaire. Other studies of goals have 
not achieved this high percent of returns. For example, the Gross and 
Grambsch (1968) study, which is the most significant effort thus far to 
examine university goals as seen by faculty and administrators in 68 different 
universities, achieved (with follow-up) a 51% return from faculty and a 40% 
return from administrators of their single questionnaire. In a recent study 
(Cyphert and Gant, 1971) of the goals of the School of Education at the 
University of Virginia by the use of the Delphi technique, 68% of the sample 
of 421 people returned the first questionnaire, while 62% returned the 
second; the exact percentage returning the remaining questionnaires is not 
clear from the data presented. 



Tables 2 through 6 indicate that the total percentages varied with 
the institution, giving a range from 78 to 91%, 69 to 86%, and 65 to 82% 
on the first, second, and third questionnaires, respectively. Regardless of 
institution, the group with the poorest percentage of returned questionnaires 
was the community, while the group with the best was the students. This was 
not unexpected since the community is probably the group having the smallest 
personal commitment to the institution and the students received a $10 
honorarium after completion of the third questionnaire! One group (parents 
of the students who were participating in the study) was included only at 



Institutions 1 and 5. Another group (advisory council) was included only 
at Institution 1. Notice that there is a wide range in the number of par- 
ticipants selected from each group. (The reasons for this have been dis- 
cussed in the Method section.) In drawing conclusions about the goals of 
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a single institution, it would be desirable to have a larger sample from 
that institution. Since this was not the main purpose of this study, the 
additional cost could not be justified. However, additional data collected 
in a substudy at Institution 4, for a different purpose, permits an evalua- 
tion of the sampling of faculty and students employed in this study. 

In this separate study, the first questionnaire was sent to a 
randomly selected group of 400 faculty and 275 undergraduate and 
275 graduate students who were not included in this study. This 
institution, a large state university with a number of academic 
schools, provided the most complex organization of the five in- 
stitutions and therefore also provided a rigorous check on the 
sampling procedure employed in the present study. The results 
obtained from this separate study, which used a large sample of 
faculty and students, were very similar to the results from the 
present study which employed a much smaller sample of faculty and 
students. It was found that in comparing faculty and student re- 
sults separately, not only were the goal areas ranked identically, 
but it was an unusual case when the means of goal areas differed 
by more than 0.1. 



Thus, at Institution 4, the stratified random sampling of faculty 
and students employed in the present study gave representative results. 
However, a disadvantage of using very small groups (e.g., alumni) is that an 
individual who changes in a small group will have a larger effect on his 
group mean than if he were in a group with more respondents. For this reason, 
it would be expected that the mean for the larger groups would be more stable 
than the mean for the smaller groups. 

Another question related to the sample is whether, on the first 
questionnaire, those participants who completed only the first questionnaire 
differed in their responses from those who completed more than one question- 
naire. This question was investigated by comparing the above two groups, 
using the individual's mean value for the goal area as the dependent variable, 
and testing for differences between the two groups using the Mann-Whitney U 
Test. In selecting groups for this analysis, attention was given to (1) not 
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combining groups and/or institutions which might mask differences; (2) having 
each participant group represented; (3) having each institution represented; 
and (4) having a reasonable number of dropouts within each group. Those 
groups selected were: community, faculty, and parents at school 1; community 
at school 2; administrators, alumni, community, and faculty at school 3; and 
faculty and students at schools 4 and 5. Rather than test each of these 
twelve groups for every goal area for both present and preferred importance, 
three goal areas were randomly assigned to each group. None of these 36 
analyses rejected the null hypothesis at the .05 level of significance, 
lending no support to the hypothesis that those participants who completed 
only questionnaire 1 responded differently to questionnaire 1 than those 
also completing questionnaire 2 and/or 3. 

Reliability Estimates of Goal Areas 

In addition to understanding the sample used in the study, it is also 
important for interpreting the results to have an estimate of the reliability 
of the measuring instrument. Table 7 presents the reliability estimates for 
both present and preferred ratings of each goal area for each questionnaire. 
Coefficient alpha (Cronbach, 1951), a generalization of the Kuder-Richardson 
formula 20, was employed as the measure of internal consistency. 

Two goal areas, Innovation and Financial Soundness, have poor reliability 

estimates. In investigating the three goal statements composing the goal area 

] 

of Innovation, it was found that statement 83, "To protect valuable traditions 
against unwarranted change," had a much larger standard deviation than either 
of the other statements, except in the two instances when the reliabilities 
were .52 (present importance ratings on questionnaires 2 and 3). In these 
latter two situations 5 the standard deviation of item 83 was similar in 
magnitude, to the otherc. Since this statement was the only goal statement 
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TABLE 7 

RELIABILITY ESTIMATES OF GOAL AREAS BY QUESTIONNAIRE 



Present Preferred . 

# of Importance Importance 

Goal Area Items Q1 Q2 03 Q1 Q2 Q3 



1 . 


Financial Soundness 




3 


.58 


.35 


.36 


.58 


.43 


.59 


2. 


Non-Academic 




6 


.68 


.57 


.57 


.78 


.78 


.81 


3. 


Intellectual Development of the 
Student 


7 


.81 


.74 


.78 


.63 


.71 


.74 


4. 


Personal Development of the 


Student 


8 


.89 


.85 


.85 


.77 


.70 


.75 


5. 


Vocational Preparation 




6 


.77 


,.53 


.58 


.73 


.69 


.76 


6. 


Religious Orientation 




6 


.93 


,96 


.97 


.93 


.93 


.95 


7. 


Training of Graduate and 
Professional Students 




5 


.75 


,65 


.65 


.72 


.64 


.73 


8. 


Research 




6 


.80 


,.82 


.82 


.76 


.68 


.75 


9. 


Local and Regional Service 




8 


.77 


.40 


.53 


.80 


.30 


.83 


10. 


National and International 1 


Service 


7 


.81 


.85 


.84 


.84 


.83 


.85 


11. 


Social Criticism 




6 


.73 


.64 


.63 


.67 


.62 


.69 


12. 


Freedom 




8 


.78 


.67 


.65 


.81 


.80 


.81 


13. 


Innovation 




3 


.09 


.52 


.52 


.02 


.27 


• 31 


14. 


Governance 




4 


.75 


.78 


.76 


.71 


.69 


.73 


15. 


Self-Study and Planning 




5 


.80 


.77 


.77 


.65 


.57 


.66 


16. 


Egalitari anism 




5 


.53 


.54 


.46 


.65 


.49 


.77 


17. 


Esprit and Quality of Life 




6 


.77 


.79 


.78 


.61 


.47 


.50 


18. 


Concern for Projecting Good 


Image 


4 


.59 


.65 


.63 


.71 


.75 


.77 



j 

i 



. 





in the instrument that was keyed in a negative direction, it is hypothesized 
that some people inteipreted it as being positive, similar to all the other 
statements, while others interpreted it correctly, which would result in 
larger standard deviations. 

Of the 96 reliability estimates from the remaining 16 goal areas, 92 
are above .50, 32 are above .60, 61 are above .70, and 27 are above .80. 

With the exception of Innovation and Financial Soundness, this data provides 
support for the internal consistency of the goal areas . These reliabilities 
are as high or higher than would ordinarily be expected from scales composed 
of 3 to 8 items, especially since they were constructed on a priori bases . 
Furthermore, since the instrument's purpose is to compare groups and not 
individuals, the goal areas (with the two exceptions) appear sufficiently 
reliable for institutional studies. 

As Davis (1965, p. 24) states: "For Measuring the average characteristics 

of groups of the size of many classes, say twenty-five to fifty, scores with 
reliability coefficients as low as .50 may often be highly serviceable. With 
average scores in larger groups, even lower reliability coefficients are 
frequently useful." 

Now that the sample has been described and the internal consistency 
of the goal areas demonstrated, some results will be presented. 

Institution and Group Comparisons 

While the detailed results obtained at each institution were the subject 
of separate reports to each institution (Uhl and Hopkins, 1970a, 1970b, 1970c, 
1970d, 1970e) and will not be presented in this report, certain general results 
are included here. Figure 1 presents the mean response:* of all respondents in 
Institution 1 to the third questionnaire for each goal area. Figures 2 
through 5 present the information for Institutions 2 through 5, respectively. 



FIGURE 2. PROFILE OF INSTITUTION 2 COMPARING MEAN RESPONSES 

TO FKfcSEfoT AnB ' JM^JAFAnCE OF GOAL AREAS 

FROM THIRD QUESTIONNAIRE 
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FIGURE 3, PROFILE OF INSTITUTION 3 COMPARING MEAN RESPONSES 
TO PRESENT AND PREFERRED IMPORTANCE OF GOAL AREAS 
FROM THIRD QUESTIONNAIRE 
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FIGURE 4. PROFILE OF INSTITUTION 4 COMPARING MEAN RESPONSES 
TO PRESENT AND PREFERRED IMPORTANCE OF GOAL AREAS 
FROM THIRD QUESTIONNAIRE 
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FIGURE 5. PROFILE OF INSTITUTION 5 COMPARING MEAN RESPONSES 
TO PRESENT AND PREFERRED IMPORTANCE OF GOAL AREAS 
FROM THIRD QUESTIONNAIRE 
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The solid line in each of the figures indicates the participants 1 
perceptions of the importance presently being given to each goal area. The 
line of dashes indicates the participants * beliefs of the degree of im- 
portance that ought: to be given to each goal area. The difference between 
the solid and dashed lines could be viewed as an indication of the degree of 
satisfaction with the present importance given to each goal area. These 
profiles can provide valuable information to an institution by identifying 
those goal areas that are high in preferred importance and also have a large 
discrepancy between the present and preferred importance, thus having the 
potential of causing dissatisfaction, tension, and even conflict. For ex- 
ample, in Figure 3 the goal areas of Intellectual Development and Self- 
Study and Planning would be among those selected for possible improvement 
by Institution 3. By examining the ratings of each of the goal statements 
which compose these two goal areas, a better understanding of the nature of 
the improvement may be obtained. While the profiles of the institutions 
are different, two areas that might be selected for improvement at all five 
institutions are Intellectual Development and Self-Study and Planning. At 
each institution these two areas are rated high in preferred importance and 
also indicate a relatively large discrepancy between the present and preferred 
importance. 

Due to the convergence among the groups at each institution in their 
responses to the third questionnaire, the institutional profiles presented in 
Figures 1 through 5, although based on the total group, are very similar to 
individual group profiles. 

To illustrate this degree of similarity among the group ratings on the 
third questionnaire, the goal areas were ranked separately for each group 
with regard to the mean importance attached to the goal area by that group. 
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By calculating the degree of relationship between the rankings of two groups 
(such as faculty and students), it is possible to identify those groups whose 
rankings are very similar and those whose rankings are different. Spearman’s 
rank-order rho was the statistic used to examine the relationship. The 
preferred importance ratings will be discussed first. It was found that in 
Institutions 1 and 5 no rho was below .80 and almost all were above .85. 

This indicates that the rankings of goals in terms of their relative im- 
portance were almost identical for the different groups at these two in- 
stitutions. (A rho of 1.00 would indicate perfect agreement with respect to 
the order of importance and a rho of -1.00 would indicate perfect disagree- 
ment.) There was also high agreement at the other three institutions. The 
rhos calculated for Institutions 2 and 3 were all above .85, except for 
trustees whose values of rho ranged from .63 to .77 at Institution 2 and 
from .72 to .79 at Institution 3. At Institution 4, with the exception of 
alumni, four of whose values ranged from .76 to .83, all rhos were above .83. 
One possible reason for the lower relationships obtained between trustees 
and other groups in Institutions 2 and 3 and alumni and other groups in 
Institution 4 is the small number in these groups who responded to the third 
questionnaire. Another possible interpretation is that there is less agree- 
ment among these groups and other groups at their institution than between 
any of the other groups. There is some support for this latter interpretation 
at Institution 2. At this institution on the first questionnaire, trustees 
ranked the goal areas in a manner similar to alumni (rho = .81) and 
community (rho = .77) but quite different from students (rho = *31), faculty 
(rho = .52), and administration (rho = .57). In fact, the results of the 
first questionnaire at this institution as well as the other private institu- 
tion (Institution 1) indicated the clustering of two groups - the on-campus 
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groups (students, faculty, administrators) and the off-campus groups (trustees, 
alumni, community). However, on questionnaire 3 the groups at Institution 1 
converged and came to some agreement. This also happened at Institution 2 
although the trustee group did not converge as much as the other off-campus 
groups. The result was that the trustee group became more similar to on- 
campus groups (with students, rho = .63; with faculty, rho = .65; and with 
administrators, rho = .69) but not to the same extent that the community and 
alumni did. (On the third questionnaire all values of rho between community 
and on-campus groups were above .93 while those between alumni and on-campus 
groups were .92 [administrators], .89 [faculty], and .81 [students]). 

In general, the degree of agreement on the third questionnaire between 
groups at each institution was even better when the present importance of 
the goal areas was being rated. This will be discussed further in the 
section concerned with measuring convergence. 

Gross and Grambsch (1968) report the similarity between the values of 
faculty and administrators in universities. This study found similar re- 
sults. The results of the first questionnaire would be the appropriate 
results to compare with Gross and Grambsch’ s study. The results of this 
questionnaire indicate that in all five institutions the preferred goals of 
the administrators were closest to those of the faculty (rho varied from 
.86 to .98). The same conclusions would be drawn from the data obtained 
from the third questionnaire. It was also found, as in the Danforth Founda- 
tion study (1969) with liberal arts colleges, that the preferred goals of 
students and faculty were very similar. (From the results of the first 
questionnaire, these values of rho varied between .87 and .93). 

Evaluation of the Institutional Goals Inventory (IGI) 

The reliability of the preliminary form of the IGI used in this study 

O 



-36- 



has already been presented. It was found that two areas. Innovation and 
Financial Soundness, had low reliabilities. All other areas were found to 
possess adequate internal consistency. The good reliability of these goal 
areas, which were composed of 3 to 8 statements, is an indication that the 
items were relatively free of double meanings. 

Another indication of support for the IGI was that although space was 
provided, very few goal statements were modified or additional goal state- 
ments added. Those few which were added did not identify any weak goal areas 
or goal statements. 

The unusually high percentage of participants completing all three 
questionnaires supports the face validity of the instrument. It is highly 
unlikely that such good returns would have been possible if the participants 
did not view the instrument as adequately measuring their goal perceptions 
and values . 

During the discussion of results with the institutions, several 
questions were asked regarding the instrument. Questions were raised as to 
why the Innovation area was not rated of higher preferred importance. The 
low estimates of reliability for this goal area provide an answer to this 
question. Discussions concerning the Religious Orientation area at one of 
the church -related schools revealed that some individuals who felt religious 
orientation was or should be an important goal rated some of the goal state- 
ments in this goal area as very low in importance. Thus, it may be necessary 
to rework a few of the goal statements in this goal area. 

Independent of the results of this study, five specialists in higher 
education who had some familiarity with the institutions participating in 
this study, were asked to select the institutions that they thought would 
attach the greatest and the least present importance to each goal area. For 
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example, in the Religious Orientation area, one of the church-affiliated . 
institutions would probably be selected as giving greater importance to this 
goal area than any of the other institutions, while one of the public 
institutions would probably be selected as giving the least importance to 
this goal area. 

Since the five institutions were selected because of their differences 
(Appendix D describes each institution), the raters could easily select 
the low and high institution for many, but not all goal areas. On some 
goal areas the raters could not agree. Table 8 illustrates the schools 
selected as presently representing the extremes in each goal area. If 
three of the five raters selected the same institution as being highest 
or lowest for a goal area, that institution was chosen to represent high or 
low importance in that goal area. If two schools were each selected by two 
raters, both were included (e.g., see Table 8, Financial Soundness, high 
importance). However, if one school was selected by two raters and the 
other raters each selected a different school or if all raters selected 
different schools, no decision was made regarding that selection (e.g., 
see Table 8, Innovation, Governance, Social Criticism - low importance, 
etc. ) . 

Support for the validity of the IGI goal areas would be demonstrated 
if, using the data obtained from each institution, the independent selec- 
tions of the raters could be verified. 

Table 8 also reports the means and standard deviations of the present 
importance ratings for each school by goal area, obtained from the first 
and third questionnaires. In addition, those institutions are identified 
which should exhibit the most extreme differences in each goal area, 
according to the independent raters. The last column indicates whether 
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TABLE 8 

MEANS AND STANDARD DEVIATIONS 
OF PRESENT IMPORTANCE OF EACH CiOAL AREA FOR EACH 
INSTITUTION AND RESULTS OF INDEPENDENT RATINES FOR EACH GOAL AREA* 

y 



Institutions Selected Means and Standard Deviations for Each 

by Independent Raters Institution on Questionnaires 1 (Ql) and 3 (Q3) 
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1,2 


4 


Q3 
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2.3 


.23 


2,7 
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2.6 


.22 


2,6 


.28 
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Non- 






Ql 


2.9 


.53 


2.9 


.52 


3.1 


.55 


3.2 


.52 


3.5 


.50 


5-78 


academic 


1,2 


4 


Q3 


3.1 


.18 


3.1 


.22 


3.1 


.30 


3.3 


.24 


3.5 


.22 
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Intellectual 






Ql 


2.3 
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2.7 
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2.6 
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2.8 
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2.8 
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1 


4 


Q3 
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2.8 
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2.6 
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2.9 
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Personal 
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3.1 
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3.0 


.55 
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Q3 
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2.9 
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2.8 
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3.2 
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Ql 


3.0 
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2.8 


.32 


2.7 


.23 


2.9 


.26 


17.33 


Religious 






Ql 


2.9 


.76 


3.4 


.75 
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3.3 
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3.2 
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- 
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2.9 
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2.6 
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3.3 
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3.0 


.58 


3.0 
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1 
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.25 


3.1 


.31 


2.9 


.33 


3.0 


.27 


3.0 


.24 
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Ql 
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.57 


2.5 


.57 


2.6 


.63 
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1 
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.26 
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2.6 
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*The lower the mean, the higher the importance 
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there is a significant difference between the means of the two institutions 
selected by the raters. (The means and standard deviations from the third 
questionnaire will be discussed in another section.) If these means are not 
only significantly different, but are also, for that goal area, the lowest 
and highest means of the five institutions, support for the validity of that 
IGI goal area is demonstrated. In certain areas (Innovation, Governance, 

Self-Study and Planning) there was no agreement among raters and therefore 

| 

they could not be validated. In three other goal areas (Social Criticism, 
Esprit and Quality of Life, and Concern for Good Image) agreement was ob- 
tained only at the most important end of the scale, so only partial vali- 
dation was possible. 

Of the twelve goal areas containing complete information, ten were 
validated. The Non-academic goal area and Egalitarianism were validated 
for the institution of highest importance, but not for the one of lowest 
importance. In both of these cases, the institutions selected as attaching 
the least importance have the means which ranked them next to lowest, rather 
than lowest, in importance. Validation was achieved in all three cases 
where only the institution rated as attaching highest importance could be 
tested. 

Summarizing, of the 18 goal areas, three could not be tested; another 
three could be partially validated, and were; of the remaining twelve, 
ten were completely validated, and the other two achieved partial vali- 
dation. Thus, with the exception of the three goal areas that could not be 
validated, strong support for the validity of the goal areas was achieved. 

Appendix F reports the intercorrelations among the goal areas based upon 
the five institutions r ratings of both present and preferred importance on 
questionnaire 3. These correlations have a similar pattern to, but are 

0 
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slightly larger in magnitude than those on questionnaires 1 and 2. While 
the correlations obtained for the individual institutions are smaller in 
magnitude due to the more homogeneous sample, the correlations based upon 
all institutions illustrate that some of the goal areas have considerable 
overlap. This result is not surprising; for example, it would be expected 
that the goal area of Graduate-Professional Training would be highly related 
to the goal area of Research. The magnitudes of the correlation coefficients 
for present importance (r=.83) and preferred importance (r=.77) support this. 
Other goal areas rated in terms of present importance and having at least 
a 50% overlap (correlations above .707) on questionnaire 3 were: Graduate- 

Professional Training and National-International Service (r=.8E), National- 
International Service and Research (r=. 77) ,. Personal Development and Intel- 
lectual Development (r=.75), and Personal Development and Religious Orienta- 
tion (r=.73). On the ratings of preferred importance, the only goal areas 
to have at least a 50% overlap were the previously mentioned Graduate-Pro- 
fessional Training and Research, and Graduate-Professional Training and 
Nationai-International Service (r=.71). Thus, a few of these goal areas 
are highly related. A factor analysis of individual items is planned and 
will assist in the further development of the instrument. 

Also reported in Appendix F are the correlations between the present 
and preferred ratings of importance on questionnaire 3 for each goal area. 

The correlations range from -.04 for the goal area Innovation to .79 for the 
goal area Religious Orientation. The median correlation is .32. Religious 
Orientation was the only goal area in which there was greater than 50% 
overlap between ratings of present and preferred importance. Thus, as one 
would expect, these two methods of rating goal statements result in different 
information. 
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there is a significant difference between the means of the two institutions 
selected by the raters. (The means and standard deviations from the third 
questionnaire will be discussed in another section.) If these means are not 
only significantly different, but are also, for that goal area, the lowest 
and highest means of the five institutions, support for the validity of that 
IGI goal area is demonstrated. In certain areas (Innovation, Governance, 
Self-Study and Planning) there was no agreement among raters and therefore 
they could not be validated. In three other goal areas (Social Criticism, 
Esprit and Quality of Life, and Concern for Good Image) agreement was ob- 
tained only at the most important end of the scale, so only partial vali- 
dation was possible. 

Of the twelve goal areas containing complete information, ten were 
validated. The Non-academic goal area and Egalitarianism were validated 
for the institution of highest importance, but net for the one of lowest 
importance. In both of these cases, the institutions selected as attaching 
the least importance have the means which ranked them next to lowest, rather 
than lowest, in importance. Validation was achieved in all three cases 
where only the institution rated as attaching highest importance could be 
tested. 

Summarizing, of the 18 goal areas, three could not be tested; another 
three could be partially validated, and were; of the remaining twelve, 
ten were completely validated, and the other two achieved partial vali- 
dation. Thus, with the exception of the three goal areas that could not be 
validated, strong support for the validity of the goal areas was achieved. 

Appendix F reports the intercorrelations among the goal areas based upon 
the five institutions' ratings of both present and preferred importance on 
questionnaire 3, These correlations have a similar pattern to, but are 

O 




-41- 



Evaluation of the y Delphi Technique 

This section considers one of the prime purposes for performing the 
study, i.e., evaluating whether the Delphi technique produces convergence 
of opinion with regard to an institution's goals among the participants in 
this study. Also included in this section is a discussion of the types of 
judgments involved and th accuracy of the technique, since convergence 
would not be very helpful xx it led to a less accurate answer. 

Investigation of convergence . One procedure for determining the occurrence 
of convergence of opinion is to calculate for each questionnaire the ab- 
solute sum of the distances between each participant's response and the mean 
of all the participants' responses, and to examine whether the value of 
this absolute sum decreases from questionnaire to questionnaire. A repeated 
measures design using multivariate analysis of variance was employed to in- 
vestigate the significance of these decreases. Separate analyses were 
performed for the rating of present and preferred importance for each goal 
area. In adrition to including the time of administration of the question- 
naire as an independent variable, school and group were also included in 
order to evaluate whether school or group interacts with time of adminis- 
tration. Thus , the degree of convergence among individual participants 
will be tested. Later in this section the degree of convergence among 
groups will be discussed. 

A multivariate rather than a univariate model was chosen because two 
assumptions of the latter model were untenable. The standard deviations 
given in Table 8 for the first and third questionnaires demonstrate that 
the assumption of homogeneous variances for the data obtained from the three 
questionnaires is not justified. While Box (1954) and Greenhouse and Geisser 
(1959) have developed approximate solutions, an exact model which does not 
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restrict these variances is more desirable. The second assumption which is 
unlikely to be characteristic of the data is that the correlation of ratings 
between questionnaires 1 and 2 will be equal to the correlations between 
questionnaires 1 and 3 and 2 and 3. For these reasons, a repeated measures 
design using a multivariate analysis of variance model (MANOVA) was used. 

By employing appropriate transformations of the data before entering the 
MANOVA program, it was possible to separate those aspects of the model due 
to the sampling of subjects from those residing in the outcome variables, 

Finn (1969) describes this procedure. 

The results of these analyses by goal areas are presented in Tables 9 
(pxesent importance) and 10 (preferred importance). The significant Q effect 
(£<.001) for every goal area in both tables indicates that convergence of 
opinion occurred. 

The degree of convergence obtained in any goal area varies for different 
schools. For example. Institution 3, while obtaining very good convergence 
in a few areas, in general obtained less convergence than the other schools. 

In any given goal area some school? will obtain more convergence than will 
others. This explains the significant interaction between school and 
questionnaire present in almost all goal areas and is illustrated in Figure 
6 (present importance) and 7 (preferred importance). These two figures 
indicate by school for each goal area the variability and the degree of 
convergence from the first to the third questionnaire. The black portion 
indicates the distance from one standard deviation above the mean on the 
third questionnaire to one standard deviation below the mean on the third 
questionnaire. The screened area which appears gray illustrates the distance 
that a standard deviation on the first questionnaire exceeded that of the 
standard deviation of the third questionnaire. Thus this area is an indica- 
tion of the convergence of opinion from the first to the third questionnaire 
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SUMMARY OF SIGNIFICANT RESULTS (j£ < .01) FROM MANOVA 
USING REPEATED MEASURES DESIGN BY GOAL AREAS 
FOR PREFERRED IMPORTANCE RATINGS 4 
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FIGURE 6. Variability (Plus and Minus one Standard Deviation) of the Ratings of Importance on Questionnaires 1 and 3. 

For' Each Institution and Each Goal Area — PRESENT Importance 
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for each goal area and illustrates well the individual differences among 
the schools. 

These results indicate that it is possible through use of the Delphi 
technique to obtain convergence of opinion among the participants in the 
eighteen goal areas included in the IGI. 

In addition to evaluating convergence among individuals, it is possible 
to examine the degree of convergence among groups. As discussed in a previous 
section. Institution and Group Comparisons , the goal areas were ranked 
separately for each group with regard to the mean importance attached to the 
goal area by that group. By calculating the degree of relationship between 
the rankings of two groups (such as faculty and administrators), it is 
possible to identify the degree of similarity in goal ratings between every 
pair of groups. Spearman’s rank-order rho was again the statistic used 
to examine this relationship. As reported in more detail in the Institution 
and Group Comparisons section, with very few exceptions the similarity in 
rankings of groups at any institution was extremely high (median rho in the 
.90s) according to data obtained on the third questionnaire. This is in 
contrast to the data obtained on the first questionnaire which indicated a 
much lower degree of similarity (median rho in the .60s). These results 
were consistent for the ratings of both present and preferred importance. 

Thus convergence of opinion occurred through the use of the Delphi 
technique among both individuals and groups participating in the study . 

Types of judgments involved . It is important to realize that ratings of 
preferred importance are asking for value judgments, while ratings of present 
importance are asking for factual judgments. Whether or not basic conceptual 
differences are involved, value judgments are certainly much more vague and 
more difficult to validate. While the Delphi technique has been used in 
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several studies to obtain value judgments, the experimental work on the 
Delphi technique has been confined to factual judgments. 

Two questions, both concerned with the types of judgments being made, 
will be considered in this section. (1) Since ratings of present and pre- 
ferred importance involve different types of judgments, would feedback of 
information influence these different types of judgments in the same manner? 
(2) Can the accuracy of the ratings of preferred importance (value judg- 
ments) be validated? 

While carefully designed experiments, rather than field studies such 
as this one, are needed to answer the first question, the results from this 
study may provide some hypotheses. An examination of the present importance^ 
attached to the different goals at each of the five institutions indicated 
that significant convergence of opinion among the participants occurred in 
all goal areas. The multivariate jF associated with this effect of conver- 
gence was based upon two dependent variables, the change from question- 
naires 1 to 2 and from questionnaires 2 to 3. By examining the univariate 
Fs corresponding to these two dependent variables, it is found that when 
14 of the 18 goal areas are rated in terms of present importance the signi- 
ficant convergence occurs from the first to the second questionnaires and 
the amount of convergence occurring between the second and the third 
questionnaires is not statistically significant. In some goal areas a small 
amount of divergence occurs in the responses to the third questionnaire. 

The RAND Corporation (Dalkey, 1969) also reports that they found feedback 
of reasons did not increase the convergence of responses, in their experi- 
ments using questions of the almanac-type (e.g.^ What were the- number of 
telephones in Africa in 1966?) These results are in contrast to the ratings 
of the same goal areas in terms of preferred importance. In the latter case, 
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in IE of the 18 goal areas, a significant amount of convergence occurred 
from questionnaire 2 to questionnaire 3. Thus the reasons given on the 
third questionnaire to support extreme views may act differentially for 
factual and value judgments. Another possibility is that with factual 
information the amount of convergence between questionnaires 1 and 2 is so 
great that .it is very difficult to produce any additional convergence. 

Several post hoc explanations for the differences in the results 
obtained using factual and value judgments can be offered, but only through 
carefully designed experiments can this issue be clarified. 

Different opinions exist with regard to whether value judgments can be 
validated. A widely neld opinion is that there is no clear sense in which 
value judgments can be said to be accurate. However, another opinion is 
offered by Dalkey (1969). He states: ". . . . value judgments are factual 
statements of an especially complex, vague, and in general much more specu- 
lative sort tiian the usual descriptive inputs to decision situations." 

A great amount of time and money is spent in making value judgments. 
This would be difficult to justify if there is no degree of correctness that 
can be attached to a value judgment. However, it is difficult to believe 
that there is not some degree of correctness or accuracy, however weak, 
attached to value judgments. For example, in forming a new college, the 
Board of Trustees and the President, after much deliberation, decide on the 
objectives of the institution. They are not likely to accept the judgment 
that any other set of objectives is as good as theirs and therefore they 
are attaching some degree of correctness to their list. If the assumption 
can be accepted that there is some degree of accuracy associated with value 
judgments such as those which were rated in terms of preferred importance 
in this study, how may this accuracy be validated? Several possibilities 
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exist. It would seem that in rating these statements in terms of preferred 
importance, certain responses are more likely than others. Thus, one 
criterion could be reasonableness. For example, it would be unreasonable 
to expect Institution 1, an institution closely related to its denominational 
church, to rate Religious Orientation as very low in preferred importance 
or for Institution 2, a four -year liberal arts institution, to rate Research 
as very high in preferred importance. In general, faculty, administrators, 
and students are attracted to institutions which presently stress goal areas 
that they think important. Thus, it would be reasonable to assume that 
those institutions that are presently very different will desire to remain 
very different. This assumption leads to the prediction that, for each 
school, the school most unlike it can be selected regardless of whether the 
goal priorities wer^ based on present or preferred importance. If this 
prediction is accurate, it provides some support for the validity of the 
preferred importance ratings. To test this prediction, Spearman ! s rank-order 
rho was calculated as a measure of the degree of dissimilarity between the 
goal priority rankings of each pair cf institutions for both present and 
preferred ratings of importance. The results are presented in Table 11. 

The present goal priorities of Institution 4 are most dissimilar to the 
present goal priorities of Institution 1. Similarly, for Institution 2, 
Institution 4 is most dissimilar; for Institution 3, Institution 4 is most 
dissimilar; for Institution 4, Institution 1 is most dissimilar; and for 
Institution 5, Institution 1 is most dissimilar. Identical results are 
obtained for the preferred goal priorities, thus providing support for the 
accuracy of the preferred importance ratings. 

If these ratings of preferred importance possess some degree of 
accuracy, another expectation would be that the judgments should exhibit 
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TABLE 11 

MEASURES OF SIMILARITY AMONG SCHOOLS AS INDICATED BY 
SPEARMAN RANK-ORDER RHOS BASED UPON PRESENT 
AND PREFERRED (IN PARENTHESES) IMPORTANCE 
RATINGS FROM QUESTIONNAIRE 1 



Institution 


i 


2 


3 


4. 


5 


1 


- 


.81 (.87) 


.69 (.91) 


.28 (.62) 


.55 (.80) 


2 


.81 (.87) 


- 


.78 (.87) 


.38 (.74) 


.71 (.80) 


3 


.69 (.91) 


.78 (.87) 


- 


.56 (.84) 


.82 (.93) 


4 


.28 (.62) 


.38 (.74) 


.56 (.84) 


- 


.70 (.89) 


5 


.55 (.80) 


.71 (.80) 


.82 (.93) 


.70 (.89) 


- 



■$& 

The larger the number, the greater the similarity. 
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a reasonable amount of group reliability, i.e., two highly similar groups 
should express similar judgments. According to Gross and Grambsch (1968) 
and verified by ratings of present importance in this study, faculty and 
administrators are two highly similar groups. Also, it was reported 
earlier in the Institution and Group Comparisons section, that students 
and faculty had very similar goal rankings based upon present importance 
ratings. Therefore, it is expected that the goal ratings in terms of pre- 
ferred importance of these similar groups will be very similar at each 
institution. 

The value of the Spearman rank -order rho between the present importance 
ratings of goal areas, based on responses to questionnaire 1, by faculty and 
administrators for each school are: .93, .95, .78, .92, and .93, respec- 

tively. With the possible exception of school 3, this verifies that these 
two groups are highly similar in their rankings of the present importance 
of goal areas. The corresponding values of the preferred importance rankings 
of goal areas based on responses to questionnaire 1 by faculty and adminis- 
trators are: .98, .86, .91, .92, and ,89. Therefore, the above expectation 
is supported for faculty and administrators. The results for faculty and 
students based upon present importance ratings are .89, .89, .80, .99, and 
.95 while for preferred importance ratings the values of .91, .87, .89* .9,1, 
and ,93 are obtained, again supporting the above expectation. These results 
provide additional support for the accuracy of the preferred importance ratings. 

If these ratings of preferred importance attain some degree of accuracy, 
a third expectation would be that they would converge given iteration with 
feedback. This expectation is suggested by Dalkey (1969), He bases this 
partly upon the consideration that if there vs a judgment that the participants 
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are trying to approximate, then individual judgments should be influenced 
in a reasonable way by the additional information furnished by feedback 
from the group. His other consideration is by analogy with factual judgments. 
Of course, the attainment of convergence has already been demonstrated. 

In summary, based upon the assumption that the accuracy of value 
judgments can be validated, three predictions concerning the ratings of 
preferred importance were made and all three were confirmed, providing 
support for the basic assumption. 

Accuracy of convergence . Another important question concerning the process 
of convergence is whether convergence leads to more or less accurate data. 
Considering ratings of present importance first, Table 8 can assist the 
answering of this question. In the IGI Evaluation Section , data reported 
from the first questionnaire was used to demonstrate the validity of 
different IGI goal areas by comparing these means with the results cf in- 
dependent ratings. It has already been illustrated that significant con- 
vergence has occurred in all goal areas from questionnaires 1 to 3. If 
accuracy has not been sacrificed, as a result of this convergence, then the 
means obtained from the third questionnaire should still discriminate 
between those institutions selected by the independent: raters as attaching 
the greatest and least present importance to each goal area. 

By comparing in Table 8 the means for questionnaire 3 and the ratings 
of the independent raters, it is found that of the twelve goal areas in 
which the raters were able to select institutions attaching the greatest 
and least importance, eight were in complete agreement; four were in agree- 
ment with the selection of the institution attaching highest importance but 
not with the one attaching lowest importance. In two of the latter four 
goal areas , those institutions obtaining the highest and lowest means on 
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the third questionnaire are not different from those on the first question- 
naire. In those three goal areas where only the institution rated as attach- 
ing highest importance could be identified, complete agreement was attained. 

Summarizing, of the eighteen goal areas, three could not be tested; 
another three could be partially tested and were found to be in agreement; 
of the remaining twelve, eight were in complete agreement, and the other 
four partially agreed. Thus, based upcn the mean importance ratings on the 
first and third questionnaires, identical results were obtained, with the 
exception of two goal areas (Financial Soundness and Vocational Preparation) 
in which agreement was not obtained with regard to the selection of the in- 
stitution attaching lowest importance. This would lend support to the con- 
tention that accuracy is not lost with convergence. But is any accuracy 
gained? 

In the above analyses, only the mean has been considered. Notice in 
Table 8 that, f the standard deviations consistently decrease from the first 
to the third questionnaire since convergence is occurring. If it is again 
assumed that the raters were correct in selecting the institutions attaching 
greatest and least present importance to each goal area, the lower standard 
deviation on the third questionnaire indicates that there were fewer people 
in error. For example, in the goal area of Intellectual Development on the 
first questionnaire, there will be a number of participants from the institu- 
tion selected as attaching highest importance to this goal who rate the 
present importance of this goal area at their institution as low or lower in 
importance than the mean of the institution selected as attaching lowest 
importance to this goal area, and vice versa. By our definition, these 
people are in error. As indicated by the much lower standard deviation on 
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the third questionnaire, there are many fewer people in error in their 
responses to the third questionnaire. In the last column of Table 8, the F_ 
values (which demonstrate the significant differences in the means of the 
institutions selected by the independent raters) are, for almost all cases, 
considerably larger for the third questionnaire than for the first, again 
indicating this smaller error, and the greater ease by which these extreme 
institutions can be differentiated. 

Perhaps a more practical illustration is to consider the decrease in 
the number of groups in error from the first to : ;he third questionnaire as 
measured by the individual group means. Figures 8, 9, and 10 illustrate 
the values of the group means and the total mean (asterisk) for each of the 
three questionnaires at three different institutions. Figure 8 represents 
Institution 5, one of the two schools rated by independent raters as attaching 
lowest present importance to this goal area, while Figure 9 represents 
Institution 1, the school rated as attaching highest present importance to 
this goal area. Notice in comparing Figures 8 and 9 that each institution’s 
group means are closer in value to the overall mean of their institution 
than to the overall mean of the other institution. Therefore, the procedure 
for measuring error being employed wou 1 i indicate that none of the groups 
were in error in their responses to any of the questionnaires. Now make 
the same comparison between Figures 9 and 10 (Institution 4, which was the 
other institution rated as attaching lowest present importance to this goal 
area) . Notice that the value of the mean of the alumni group (G) at Institu- 
tion 4 is closer to Institution l's mean than its own institution's mean on 
the first questionnaire. However, note this group's mean on questionnaires 
two and three; on each questionnaire it comes closer to its own institution 's 
overall mean so that on the latter two questionnaires the mean of the alumni 
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FIGURE 8, PLOT OF GROUP K3ANS INDICATING 
A GROUP 1 S PERCEPTION OF THE PRESENT 
IMPORTANCE OF ^TOlcUS ORIENTATION GO/’LS 
FOR 111 '. ;? I TUT ION 5 
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I FIGURE 9. PLOT OF GROUP MEANS INDICATING 

A GROUP 1 S PERCEPTION OF THE PRESENT 

1 IMPORTANCE OF RELIGIOUS ORIENTATION GOALS 

FOR INSTITUTION 1 
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FIGURE 10. PLOT OF GROUP MEANS INDICATING 
A GROUP’S PERCEPTION OF THE PRESENT 
IMPORTANCE OF RELIGIOUS ORIENTATION GOALS 
FOR INSTITUTION k 
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group is much closer to its own institution's mean than tc Institution I's 
overall mean. Thus, while the alumni group would be considered to have an 
erroneous judgment on the first questionnaire, their judgment on the second 
and third questionnaires is not considered to be in error. 

Each goal area was investigated and the number of group errors (as 
defined above) made in response to each questionnaire was tabulated. It was 
found that of the 184 groups investigated, 22 groups were in error on the 
first questionnaire, one group was in error on the second questionnaire, 
and five groups were in error on the third questionnaire. Thus, in terms 
of group ratings of the present importance of goals, strong support is 
demonstrated for there being an increase in accuracy in the responses to 
questionnaires 2 anl 3. 

In a previous discussion of the types of judgments involved in the 
ratings of present and preferred importance, three predictions were supported 
based upon the assumption that che accuracy of ratings of preferred im- 
portance can ‘be validated. One of these predictions was that those institu- 
tions that were presently very different will desire to remain different. 

To investigate the accuracy of this prediction, Spearman* s rank-order rho 
was employed as a measure of the degree of dissimilarity between the goal 
priorities of each pair of institutions using the present and preferred 
ratings of importance from questionnaire 1. These results which supported 
the prediction were shown in Table 11. If accuracy is not sacrificed to 
obtain convergence on ratings of preferred importance, it would be expected 
that similar results would be obtained with regard to preferred importance 
whether ratings from questionnaire i or 3 were used. Table 12 presents 
these results, based upon the preferred importance data f^om questionnaires 
1 and 3. The similarity is apparent. If, for each school, a rank ordering 

O 
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TABLE 12 

MEASURES O' SIMILARITY AMONG SCHOOLS AS INDICATED BY 
SPSAHknf. RANK-ORDER RHOS BASED UPON PREFERRED 
IMPORTANCE RATINGS FROM QUESTIONNAIRE i 
AND QUESTIONNAIRE 3 (IN PARENTHESES ) 



!• 

|v 

f 

(. 

f. 

'f 

r 



l 

t 



o 




Institution 


1 


2 


3 


4 


5 


1 


- 


.87 (.91) 


.91 (.88) 


.62 (.67) 


.80 (.77) 


2 


.87 (. 01 ) 


- 


.87 (.74) 


.74 (.67) 


.80 (.71) 


3 


.91 (.88) 


.87 (.74) 


- 


.84 (.72) 


.93 (.80) 


4 


.62 (.67) 


.74 (.67) 


.84 (.72) 


- 


.89 (.77) 


C. 


.80 (.77) 


.80 (.71) 


.93 (.80) 


.89 (.77) 


- 


#■ 

The larger the number, the greater the 


similarity. 
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of the other schools in terms of similarity was performed* only three changes 
would be made in the rankings,, one of which was a tie. Thus* in this 
situation, there doesn’t seem to be any loss of accuracy with convergence. 

In summary* it was found that the process of convergence did not produce 
less accurate data, and there is at least one indication where the accuracy 
was increased. 

Summary of Results, Conclusions, and Implications 

While there were several purposes for the study, two main objectives of 
this paper were to report (1) how well the preliminary form of the Institu- 
tional Goals Inventory identifies ah institution’s goals as perceived by 
different groups, and (2) whether the Delphi technique produces opinion 
convergence among different on-cpmpus and off-campus groups with regard to 
an institution *55 goals. A summary of results and conclusions with regard 
to these two objectives is presented in this section, followed by a discussion 
of the study’s limitations and implications. 

Institutional Goals Inventory* * 

A conclusion based upon the results obtained from a variety of different 
types of data is that, with the exception of two goal areas, the preliminary 
form of the IGI served its purpose well. A brief summary of the results 
leading to this conclusion follows. 

1. An unusually high percentage of participants (75%) completed 
the three questionnaires. It is highly unlikely that this excellent parti- 

**ETS has copyright ownership of this instrument, but has granted to RELCV 
a five year royalty free non-exclusive license to reproduce and use the 
IGI in connection with its program of AOS in its consortium colleges 
and universities. 

O 
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cipation would have been possible if the participants did not view the 
instrument as adequately measuring their goal perceptions and values. 

2. Very few goal statements were modified or additional goal 
statements added, even though space was provided for this purpose. 

3. The 108 reliability estimates (coefficient alphas for "is" 
and "should be" and for each questionnaire), with the exception of the 
Innovation and Financial Soundness areas, were as high or higher than would 
ordinarily be expected from scales composed of 3 to 8 items constructed on 
a priori bases. Omitting the reliabilities from the above two areas, 82 

of the 96 remaining reliability estimates were above .60 with a median i 

value of .77. Thus, 16 cf the 18 goal areas were sufficiently reliable 
for group comparisons within or among institutions. 

4. Independent of the results of this study, five specialists 

in higher education who had some familiarity with the institutions partici- 
pating in this study, were asked to 5>elect the institutions that they thought 
would attach the greatest and the least present importance to each goal 
area. In twelve goal areas the independent raters were able to identify 
those institutions that they thought would attach the greatest and least 
present importance to each goal area. In another three goal areas (Social 
Criticism, Esprit and Quality of Life, and Concern for Good Image), they 
could agree on the institutions which would attach greatest importance but 
not the ones attaching least importance. Thus, 27 selections were made 
independently of the data collected, in this study, 15 representing greatest 
importance and 12 representing least importance. (In the remaining three 
goal areas of Innovation, Governance, and Self-Study and Planning, there was 
not sufficient agreement among the raters at the low or high importance end.) 
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By comparing these ratings with the mean ratings of the participants at each 
institution, it was found that 24 of the 27 selections by these independent 
raters were verified by the data from the IGI. 

Delphi Technique 

Two ways in which the procedure employed in this study differed from 
the standard Delphi technique were: (1) in the use of groups of constituents 

who were not necessarily experts and (2) in the use of a specially designed 
instrument to assess the ratings of importance for stated goals (Institu- 
tional Goals Inventory). Since including representatives of both on and 
off-campus groups was an objective of this study, it was not an objective 
to employ experts per se . The results of experiments by Brown, Cochran, 
and Dalkey (1969) using students as participants suggest that there is no 
great loss in including less knowledgeable individuals as long as some 
individuals are knowledgeable in the subject’ area. While the use o. the IGI, 
the second difference noted above, is in contrast to the standard Delphi 
procedure of asking each participant to provide a list of institutional 
goals that they thought were important, it offers at least three advantages, 
especially when there are a large number of participants. One advantage 
is that of time. If there are a large number of participants, there usually 
is not enough time between rounds 1 and 2 to combine the individual lists 
and devise an adequate set of clear goal statements. In contrast, in devel- 
oping the instrument before the start of the study, it is possible to write, 
test, and revise the goal statements until they are satisfactory. Another 
advantage is that in the development of an instrument it is possible to 
include as many experts as desired to ensure that statements are not omitted 
which may be of value. If the sample participating in the study are not 
experts, it is more likely that important statements may be omitted. A 
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third advantage of using a valid instrument is that it greatly simplifies 
the task for the participants. In goal studies which have not used an in- 
strument and have had several hundred participants (e.g., Norton, 1970, 
and Cyphert and Gant, 1971), a greater percent of their sample was lost in 
this first step than in all other steps combined. 

While the goal areas in which convergence occurred varied by institu- 
tion, with no institution obtaining convergence in all goal areas, the 
results demonstrate that it is possible through the use of the Delphi tech- 
nique to obtain convergence of opinion among both individual participants 
and groups in any of the 18 goal areas included in the IGT. In the ratings 
of the present importance of the goal statements, with few exceptions, all 
the convergence occurred on the second questionnaire when the modal values 
were given. However, with ratings of preferred importance the results in- 
dicate that, while most of the convergence again took place when the modal 
values were fed back, additional convergence occurred on the third ques- 
tionnaire when the feedback of reasons was also given. Differences between 
these two types of judgments were discussed and several predictions to 
test their accuracy were made and confirmed. 

Since it was demonstrated that convergence of opinion does occur, a 
question of importance is whether its occurrence leads to more or less 
accurate data. Results indicated that the process of convergence certainly 
did not lead to less accurate data and in some instances the accuracy was 
improved. 

General Conclusions 

Thus, the instrumentation and technique used in this study to assess the 
present and preferred goals of five colleges and universities with quite 



- 67 - 



different characteristics were successful. Not only were they assessed, but 
in most goal areas where there existed some differences in opinion concerning 
the importance of the goal areas, agreement was achieved. This is not meant 
to imply that attitudes were changed; they may or may not have been. It may 
have been that changes occurred through feedback as a result of participants 
considering dimensions of the problem which they had not previously considered. 
For whatever reason, the different groups came to much greater agreement as 
to what the present goals of the institution are and what they should be. 

The degree to which the instrument and the technique worked together is veil 
demonstrated by the excellent participation achieved. 

Limitations 

Due to financial restrictions, a larger sample could not be selected. 

Such questions as the following could be answered, had a larger sample been 
employed. If a person is fed back his previous response along with the modal 
response, will convergence be hindered or facilitated? If a person is fed 
back his own group* s modal response rather than, or in addition to, the 
overall group*s modal response, how will it affect the degree of convergence? 
While convergence did occur in this study, experimental studies are needed 
to investigate why convergence occurs. 

While the preliminary form of the Institutional Goals Inventory accom- 
plished its job remarkably well, it can be improved, hopefully, within a 
short time, ETS will have a form of the IGI that will be available to all 
institutions . 

Major on and off-campus events are likely to affect the ratings of 
importance given to individual goal statements. For example, on one campus 
it was difficult to understand the ratings of certain goal statements. 

However, when it became known that there had been a major confrontation on 
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this campus shortly before one of the questionnaires was sent, the change 
in ratings was very interpretable. Thus, when interpreting the results from 
these questionnaires, one should be aware of the major events or unusual 
changes which have occurred between questionnaires and consider their possible 
effect on the ratings. 

Implications 

The Assembly on University Goals and Governance has asserted, as reported 
in The Chronicle of Higher Education (1971a): "One thing is clear. If 

the colleges and universities are to improve themselves, they need to become 
more self-conscious about themselves, more understanding of what they have 
been and better informed about what is happening to them, and what their 
strengths and weaknesses are." 

The present study investigates the suitability of combining a goals 
instrument and the Delphi technique to assist higher education institutions 
in achieving a better understanding of their goals as seen by different on 
and off-campus groups. Through use of this procedure, an institution not only 
finds out what these varied groups agree are its present goals but also in 
what directions they agree that the institution should be heading. Of course, 
another approach toward achieving some consensus among these groups with 
regard to the institution's goals is to have face-to-face discussions. 

However, much research (e.g., Kelley and Thibaut, 1954, and Asch, 1958) 
indicates that agreement is less likely to happen in face-to-face discussions. 
Also, as Dalkey (l969) reports in some experiments using almanac-type ques- 
tions comparing face-to-face discussion with the Delphi technique, more often 
than not the face-to-face discussion leads to less accurate group conclusions 
while the Delphi technique more often than not leads to more accurate group 
conclusions. Thus, the application of the Delphi technique may be a more 
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useful way of deciding upon goals than the more commonly used method of 
committees, faculty meetings, meetings of department heads, etc. It also 
can be less time consuming. Therefore, this technique should be useful in 
institutional planning as a part of a continuing evaluation process, and 
as an input into RELCV's Administrative-Organizational Systems. 

One example of how these results might be useful in planning is to 
identify those goal areas with a large discrepancy between present and pre- 
ferred importance. These differences can be viewed as an indication of the 
degree of satisfaction with the present importance given to each goal area. 

Then from these goal areas selected because of their large discrepancy, 
those highest in preferred importance can be identified. The areas that 
meet these two criteria have the greatest potential for causing dissatis- 
faction, tension, and even conflict. By examining the data from each 
group, the group or groups possessing this potential can be identified. 

By examining the ratings of the individual goal statements which comprise 
each goal area, greater insight into the nature of the dissatisfaction 
may be obtained. 

Using the IGI as part of the Delphi technique may also be of value in other 
ways. For example, it is possible for the president of an institution to 
learn a great deal about the goal opinions of different groups. Not only 
can he learn what the majority believes to be important goals, but he can 
also become aware of minority beliefs and the reasons behind these opinions. 
While the individual respondents remain anonymous, each group can be coded 
so that the president can identify those groups who strongly support a goal 
and those who do not, and the reasons for the minority opinions. This would 
not only be useful to the president, but it would provide each group with a 
better understanding of the perceptions and values of other groups who are 
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also concerned with the institution. It also offers a way for a new, high 
level administrator to become quickly familiar with the perceptions and 
thinking of different groups with which he will be working. In a short 
period of time he can obtain insight into the interrelationships of groups 
within his institution by reviewing the results of several administrations 
of the questionnaire. Instead of taking several weeks or months feeling 
his way, a profile of each group in terms of goals is immediately available 
to him. 

The technique has also been found to be useful in curriculum development 
in a higher education setting. The following is quoted from an article 
appearing in College and University Business (Judd, 1970): M In essence 

Delphi permits gaining the individual views of all while not submerging 
the individual views of anyone. Does the process (Delphi technique) work 
in higher education? The chairman of a liberal arts college's committee 
charged with developing the curriculum for a new branch campus used 
Delphi and concluded: 'I would use the Delphi method wherever I knew 

there would be quite a variety of attitudes in an organization, such as a 
faculty, and where I wanted to ascertain what kind of consensus you could 
achieve. I think it aided us tremendously in knowing what we were "getting 
into." We came out of this Delphi experience with a highly innovative and 
experimental type of curricular program that has been adopted by an extremely 
conservative faculty.' " 

In these critical times for higher education, communities are being 
called upon to rethink their fund, .ental orientations. It is important 
that institutions develop rational processes by which some agreement can be 
achieved among their constituent groups with regard to their goals. 
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APPENDIX A * 

*ic 

AREAS REPRESENTED ON THE IGI 



Financial Soundness 

21. To intensify efforts to increase the institution's financial resources 

42, To increase the number and diversity of sources of income. 

105. To apply cost criteria to curricular and instructional alternatives. 

Non-Academic 

1, To help students develop social skills, poise, and confidence. 

22. To provide students with opportunities to develop lasting friendships. 

43. To provide opportunities for students to find marital partners. 

57. To establish a period of the student's lives which can always be 
remembered for its fun, friendship, and freedom. 

86. To provide a strong program of intercollegiate participation in musical 
activities, athletics, etc. 

104. To provide a strong intramural athletic program. 

Intellectual Development of the Student 

2. To help students develop the ability to apply critical thought to all 
areas of life. 

12. To help students develop the ability to speak and write effectively. 

23. To increase the desire and ability of students to undertake self- 
directed study. 

44. To help students acquire depth in at 3.east one area of knowledge. 

58. To instill in students a respect for knowledge for its own sake. 

67, To assist students acquire a basic knowledge in the humanities, social 
sciences, and natural sciences. 

103, To help students develop the ability to synthesize knowledge from 
different sources. 

Personal Development of Student 

3. To promote concern in students for the well-being of others. 

17. To prepare students for the duties and responsibilities of citizenship. 

24. To enable students to develop a set of principles to guide their behavior 

37. To help students to lead satisfying personal and social lives. 

59. To help students develop the capacity to assume leadership. 

68, To help students develop a respect for their own abilities and an 

understanding of their limitations. 

91. To help students develop an appreciation of cultural activities (e.g., 
literature, art, drama, music) . 

102. To help students iri the choice of a personally satisfying vocation. 

Vocational Preparation 

4, To ensure that students will be well qualified for a vocation. 

25 , To help students achieve positions of status and leadership in society. 

38- To help students acquire the ability to adapt to new occupational rec[uire 
ments as technology and society change. 

45, To provide an opportunity for re-educating and retraining those whose 
vocational capabilities have become obsolete. 

69, To provide students with an opportunity to acquire a broad understanding 
of the variety of occupational possibilities. 



* Appendix A is reproduced by permission of ETS, the copyright owner, 

**The numbers indicate the order i^t which the statements appear on the 
questionnaire. 



-75- 



Vocational Preparation Cont 

76. To provide a wide range of opportunities for specific occupational 
preparation, e.g., accounting, engineering, pharmacy, etc. 

Religious Orientation 

5. To educate students in a particular religious heritage. 

26. To teach students to espouse and defend a theological position. 

46. To strengthen the religious f'. ' h of students. 

61. To help students develop a dedication to serving God in everyday life. 

77. To help students become aware of the potentialities of s i full time 
religious vocation. 

101. To enable the student to see religious significance in all activities. 

Training of Graduate and Professional Students 

6. To provide, through graduate programs, new generations of scholars 
and scientists. 

27. To provide a strong professional training in various areas (e.g., law, 
medicine, business, education, etc). 

60. To expect faculty who teach in the graduate school to perform research. 

78. To have faculty provide, by example, research models for students. 

100. To discover and encourage exceptional scholars and professionals 

who will attain eminence and bring recognition to the institution. 

Research 

7. To conduct research which may facilitate the solution of specific 
social, economic, or technological problems. 

28. To perform applied research for government, business, or industry. 

4/. To contribute to the advancement of knowledge for its own sake. 

70. To provide research opportunities for the intellectual growth 
of the faculty. 

87. To attract faculty who have distinguished themselves through research 
and scholarly contributions. 

98. To reward excellence in research and scholarly inquiry through pro- 
motions and salary increases. 

Local and Regional Services 

8. To serve as an educational agency for the surrounding community. 

29. To be responsive to the cultural needs of the local community 
48. To help solve social, economic, or political problems in the 

.immediate geographical area. 

56. To reward faculty who provide outstanding service to the local or 
regional area through promotions and salary increases. 

71. To apply the technical expertise available at the institution to the 
solution of state and regional problems. 

79. To prepare students for service to the community. 

88. To provide educational opportunities for adults in the local area. 

97. To provide opportunities for advanced level, adult continuing education. 



National and International Service 

9. To apply resources of the institution to the solution of major national 
problems. 

30. To help formulate programs in a number of public policy areas such 
as pollution control, urban renewal, and health care. 

62. To provide technical assistance to agencies of the national government. 
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National and International Service Cont 

74. To give technical assistance to developing nations. 

82. To give technical assistance to agencies for international development. 

96. To assist in efforts to achieve and maintain world peace. 

99. To help students develop a sense of responsible membership in the 
world community. 

Social Criticism 

10. To provide critical evaluations of prevailing practices and values 
in American society. 

31. To help students acquire respect for prevailing political and social 
institutions in America. 

49. To function as an agent of direct social action. 

63. To enable students to understand the value of dissent in a democratic 
society. 

72. To encourage students to become aware of social problems. 

80. To help students learn how to change society. 

Freedom 

11. To ensure that students have the opportunity to hear all points of view. 

32. To protect a faculty member against intimidation by those who do 
not approve of ideas he may present in the classroom. 

50. To ensure the right of faculty members to engage in off-campus 
political activities without fear of reprisal from the institution. 

64. To allow wide latitude in the choice of topics that faculty members 
choose for their research as long as the research is conducted in 

a responsible manner. 

73. To permit an undergraduate student wide latitude in selecting the 
courses he will take toward his degree. 

81. To permit stucents to publish their own newspaper without approval of 
content by the faculty or administration. 

89. To ensure the freedom of students to make their own decisions about 
dress and personal appearance. 

95. To ensure the rights of students to engage in off-campus political 
activities and social actions without fear of reprisal from the 
institution. 

Innovation 

13. To experiment with new forms of instruction. 

33. To innovate in developing educational programs for special categories 
of students e.g. , disadvantaged students, very bright students, foreign 
students, etc. 

83. To protect valuable traditions against unwarranted change. 

Governance 

To ensure student participation in institutional decision-making. 

To ensure that all those who are affected by an institutional decision 
have an opportunity to express their views on it before it is made. 

To ensure faculty participation in institutional decision-making. 

To decentralize decision-making to the greatest extent feasible. 
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Self-study and Planning 

15. To respond to internal needs arid goals of the institution rather 
than to external pressure. 

35. To establish and clearly define the purposes the institution will serve. 

52. To establish a long-range plan for the institution. 

85. To re-examine periodically the degree of concensus concerning the 
institution's purposes. 

94. To provide a continuing plan of curricular and instructional 
evaluation for all programs. 

Egalitarianism 

16. To mak^ available financial assistance so that any academically 
qualified student is able to enroll and remain in college. 

36. To make special efforts to attract faculty members who are also 
members of minority groups. 

53. To provide soir"' form of education for any student, regardless of 
his academic ability. 

65. To encourage students to view members of various religious groups, 
minority groups, etc., as individuals rather than as members of a 
particular group. 

93. To allocate percentages of the total enrollment for minority groups 
or groups having low socioeconomic status. 

Esprit and Quality of Life 

18. To encourage a concern for the welfare of the institution among 
faculty members, students, /and administrators. 

39. To maintain an atmosphere of intellectual excitement among faculty, 
students, and administrators. 

54. To encourage mutual trust and respect among faculty, students, and 
administrators • 

66. To maintain a distinctiveness that sets the institution apart from 
other institutions. 

75. To maintain an environment of amicable social discourse. 

92. To provide a supportive environment for highly creative individuals. 

Concern for Projecting Good Image 

19. To insure confidence of alumni and other financial contributers . 

40. To make sure that the institution receives its share of favorable 
attention in the mass media. 

55. To encourage students and faculty to compete for prestigious awards 
such as Rhodes Scholarships, Fullbright Fellowships, etc. 

90. To avoid having the reputation of the institution damaged by the 
action of a few students or faculty. 

Miscellaneous 

20. To base faculty promotion and tenure more on an estimate of teaching 
effectiveness than on the value of scholarly research. 

41. To reward excellence in teaching through promotions and salary increases. 
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In the above example, the person has indicated that he believes the goal "to assist students to prepare for graduate school" is presently of 
low importance at this institution, but that it should be of high importance. 
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To help formulate programs in a number 
of public policy areas such as pollution 
control, urban renewal, and health care. 
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To encourage faculty who teach in the 
graduate school to perform research. 
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To provide research opportunities for the 
intellectual growth of the faculty. 
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THANK YOU 

Please use the arrlosed, self-addressed, reply envelope to return this questionnaire. 



APPENDIX C 

INSTRUCTIONS FOR THE SECOND 
S THIRD ADMINISTRATIONS OF THE IGI 
(reduced in size) 
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Appendix D 

Descriptions of Participating Institutions 
INSTITUTION # 1 

Institution # 1 is a private, senior, coeducational, predominantly 
white, church-affiliated, liberal arts college. The university 
has a faculty of approximately 120 and an enrollment of about 2,000 students 
Admission is selective. Average SAT scores for 1968-69 were 539/552.* 

Eighty-two percent of all students accepted were in the top 40% of their 
graduating class. About one-half of those entering as freshmen graduate four 
years later. Costs are $2,700 (tuition, board, room). Financial assistance 

i 

is available. Approximately 72% received some! financial assistance in 1968. 

A little over 70% live on campus. The school Jaffers a full extracurricular 

program, with sports being very popular. Religious influence is felt through - 

| 

out the campus. Weekly chapel and six semester hours of theology are required 
Approximately 60% of the faculty have Ph.D.s. j 

Purpose* * 

This institution is a coeducational liberal arts college that aspires 
to academic excellence under Christian influences. It is operated in the 
belief that the function of a modem liberal arts college is to educate men 
and women to become responsible citizens and intellectual leaders in the human 
community. To this end, students are given opportunities to develop inquiring 
minds, an appreciation for intellectual discipline, and an open-minded delight 
in freedom of inquiry and pursuit of truth. By stressing the arts and sciences. 



*These are Verbal and Mathematics scores, respectively. 
**Taken from the institution’s bulletin. 




by fostering Christian character, and by emphasizing the value of a broad 
foundation for specialized careers, the institution aims to develop individual 
excellence and to prepare students for living as well as for a livelihood. 

The basic curriculum is designed to develop in each student a mature 
proficiency in the use of the English language, an awareness of human history, 
and an appreciation of man's cultural, scientific, and social achievements. 

The upper-level courses provide opportunities for concentration in areas of 
special interest and in certain professional and utilitarian branches of 
learning. Graduate work at the master's degree level is offered in areas 
where there are demonstrated needs and appropriate resources. 

Distinctive Features 

Based on a recent self-study, this institution considers its program 
distinctive for the following reasons: 

1. The faculty concerns itself first with effective teaching, including 
effective use of the classroom, library, and laboratory, 

2. The Christian atmosphere contributes to the development of moral 
responsibility and spiritual maturity. 

3. In keeping with the wishes af its founders, it continues to 
educate future ministers and lay leaders for the denomination. 

4. The size of the college permits the individual to know the whole 
institution rather than a single school or department. The result 
is a sense of belonging, of being a part of the whole, yet of 
retaining one's identity as 'an individual. Class size permits a 
relationship among faculty members and students which encourages 
maximum personal and intellectual development. 




O 



5 . 



The total program stimulates the student to develop independence 
and poise both as a scholar and as a person. Members of the faculty 
and professional advisory staff are available to give the benefits 
of their training and experience as a supplement to student initiative. 

6. The institution draws students from a wide cross-section of economic, 
social, and cultural backgrounds, both fvom within and without the 
region, and from various races, nationalities, and faiths. 

7. The primary role of the college is to provide an undergraduate 
program of high quality. Even though research is being done by 
many members of the faculty, the primary emphasis is upon teaching. 
Research activities are considered necessary to keep the faculty 
members on the "cutting edge" of their discipline in order to 
enhance the teaching function. 



Institution # 2 is a private, senior, coeducational, predominantly 
white, church-related, liberal arts college. The college 

has an enrollment of about 1,600 students and a faculty of about 100. .Sixty- 
percent of all applicants are accepted. Mean SAT scores are 468/486. Two- 
thirds of the freshmen were in the top half of their graduating class. Costs 
are approximately $2,650 for a resident. Seventy-five percent of all students 
live on campus. Some financial aid is available. Approximately 20% of the 
faculty have Ph.Ds. 

Purpose* 

This institution is committed to the Christian-democratic principle 
*Taken from the institution’s bulletin. 



INSTITUTION # 2 
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tiiat every individual is of infinite worth within the brotherhood of mankind. 

On the basis of this principle, its paramount objective is to enable the student 
to achieve 1:he highest possible degree of self-realization and to make his 
greatest contribution to human welfare. 

The college endeavors to provide a program of liberal education, including 
a sound core of general studies consistent with the needs of youth in con- 
temporary society, and such vocational courses as are in keeping with its 
resources and objectives. 

The college believes that its objectives can best be attained by striving 
for the following goals: 

1. To provide a program of studies which will enable the student to 
attain his maximum intellectual development and broaden his outlook 
on life. 

2. To foster and maintain a meaningful religious life which will 
deepen the student's insights into the spiritual significance of 
his own and all life. 

3. To enhance the student's understanding and appreciation of what is 
excellent in life and to encourage him to strive for it. 

4. To help the student to know himself and to become a physically 
healthy, emotionally mature, and socially adjusted person. 

5. To assist the student in selecting and preparing for a satisfying 
vocation. 

6. To help the student become a well -integrated, responsive, and 
responsible member of a democratic society striving to promote the 
universal fellowship of men under the fatherhood of God, 
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INSTITUTION # 3 

Institution # 3 is a public, senior, coeducational, predominantly 
black university. It has an enrollment of about 3,000 students and a faculty 
of about 250. Average SAT scores of entering freshmen are 350/374. Students 
?ve given a good deal of freedom. Class attendance is not required. Few 
students live on campus. 1968-69 costs were $1,400 (tuition, room, and board) 
for a state resident. An additional $400 is required for out-of-state students 
Financial aid is also available for many students. Approximately 40% of the 
faculty have Ph.D.s. 

Purpose* 

This is a recently created regional university. Through the undergraduate 
offerings (and to some extent through the graduate and professional programs) 
attention is directed to the achievement of the following objectives: 

1. Development of perspective and intellectual strength for the 
endeavor of a lifetime. 

2. Acquaintance with our cultural heritage as a background for under- 
standing and relating to the existing social order. 

3. Provision of a climate for high-quality learning with special 
emphasis on education for knowledgeable, intelligent , responsive 
participation in the home, the community, and a career. 

4. A liberal education with a number of opportunities in specialized 
education so that students are prepared to pursue various pro- 
fessional careers with confidence and competence. 

5. Recognition of the need for continuous learning throughout one’s life 

in order to be effective, responsible citizens in a rapidly changing 
society. 

*Taken from the institution’s bulletin. 
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INSTITUTION # 4 

Institution M is a public, coeducational, predominantly white, major 
university established originally as a land-grant institution with original 
responsibility in the area of "agriculture and the mechanics arts." It is 
now composed of eight academic areas, a graduate school, and conducts research 
and extension programs throughout the state. It has an enrollment of about 
11,000 students of whom approximately 2,000 are engaged in graduate study 
and a professional staff of over 1,000. Average SAT scores of entering 
freshmen are 491/589 and 95% were in the top one-half of their graduating 
class. Fifty percent of all applicants are accepted. Students are given 
a good deal of freedom. Most undergraduates live on campus. Costs are 
approximately $1,400 (tuition, room, and board) for a state resident. 

Financial aid is available for many students. Faculty are well qualified. 

This institution is dedicated to serving the state and nation through 
instruction, research, and extension. To accomplish this, there are eight 
undergraduate schools, more than 70 degree programs, the graduate school 
and numerous special research centers, institutes and interdisciplinary 
education, research and extension programs. 

INSTITUTION # 5 

Institution # 5 is a public, senior, coeducational, predominantly 
white, urban university. It has an enrollment of about 10,000 students 
and a faculty of approximately 450. Mean SAT scores are 420/450. Ninety- 
two percent of all applicants are accepted. Forty-three percent of the 
freshmen were in the top 40% of their high school graduating class. 
Approximately 50% are part-time students. Costs are approximately $200 for 
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tuition. Almost no financial aid is available. Only 10% of entering 
freshmen graduate four years later. 



Purpose* 

The purpose of this institution is to enrich the life of the community, 
the state, and the nation by seeking to develop in its students the imagi- 
nation, intelligence, and awareness of values which will enable them to 
assume places of leadership in a rapidly expanding society. The university 
offers each of its students opportunity and encouragement to acquire, to 
his fullest capability, the knowledge and understanding necessary to meet 
the problems and to secure the advantages of life. The institution believes 
that the best means of achieving these objectives is a firm grounding in the 
liberal arts, both as a .basis for advanced and specialized study and for 
total development of the individual. Consequently, a substantial core of 
liberal arts subjects is required for each degree offered. The university 
offers the privilege of attendance to every qualified person who wishes to 
make use of its facilities to develop and refine his abilities. 

While regarding the dissemination of knowledge as one of its basic 
objectives, the university also places high value upon the creation of 
knowledge. A primary function of the university is to stimulate the creative 
impulses of faculty and students so that significant intellectual advances 
may be made through the various channels of research. While new knowledge 
is discovered through the personal and creative study of the faculty, the 
student has professional guidance in the initial stages of his own 




*Taken from the institution's bulletin. 



- 107 - 



scholarly investigation. 

The institution also seeks to serve the community in a direct and 
immediate way through its faculty and students, who are encouraged to 
participate in the social and cultural life of the area. Thus the univer- 
sity attempts to extend itself beyond the boundaries of the campus and to 
become a significant and constructive force in the community. 
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Appendix E 

Chronological Procedure of Study 

The time schedule for this project was extremely critical since 
three questionnaires had to be administered, one each at the beginning of 
March, April, and May, and data from the preceding questionnaire needed 
to be analyzed for use on the following questionnaire. This appendix 
presents chronologically the steps employed in this study. 

I. November, 1969 

A. Constructed a schedule for the administration and processing 
phases of the project. 

B. Investigated local printing and processing firms and identified on 
which could produce the work according to the study’s critical timt 
schedule. 

C. Worked with RELCV in identifying institutions which would represent 

differences on the following dimensions: public - private, 

university - college, sectarian - nonsectarian, and predominantly 
Negro - predominantly Caucasian. Developed list of first five 
choices and five alternates. 

II. December, 1969 

A, Visited chosen institutions to explain project and elicit their 

participation. Asked each president, who was interested in partici- 
pating, to assign an individual to serve as liaison with the project 
director, this individual to receive $100 honorarium for his 
assistance. 

III. January, 1970 

A. Contacted liaison person on each campus by telephone or personal 
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visit to explain project and request the following information: 

1. College catalog 

2. Current list of faculty 

3. Current list of department chairmen 

4. Current list of administrators 

5. Current list of junior and senior students, excluding transfers, 
giving their major, sex, class, and local mailing address 

6. At one institution, current list of graduate students who had 
been on campus at least one year to include major, sex, and 
local mailing address 

7. List of active trustees and their addresses 

8. List of active alumni such as alumni officers and their 
addresses 

9. List of students who were members of minority racial and 
ethnic groups 

10, List of names and addresses of members of off-campus groups 

(different religious, political, vocational groups, in addition 
to prominent community members such as mayor, local newspaper 
editors) 

B. Received information from liaison person usually in the form of 
computer printouts, faculty and staff directories, and college 
catalogs. (The community group was identified, when possible, using 
the following categories; community leaders, political leaders, 
active religious leaders, and leaders in minority groups) 

C. Selected faculty from the faculty and staff directories, drawing a 
random sample stratified by department and excluding department 
chairmen. Approximately 25 faculty members were selected in each 
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institution, except for Institution 4, the largest institution, 
where 45 faculty were selected. 

D. Selected administrators, including department chairmen, deans 
of any schools or divisions, Dean or Vice President for 
Academic Affairs, President, and provosts. If an institution 
had more than 40 classified in the above categories, random 
sampling of department chairmen was employed. 

E. Selected trustees and alumni from the lists provided by the 
liaison person, choosing randomly the desired number. 

F. Selected approximately 250 students from the undergraduate and 
graduate group lists supplied by the liaison person. A 
random sample stratified by department and sex was drawn, and 
these students were mailed a double postcard. On one-half of 
the postcard was a description of the project and an offer of 

a $10 honorarium for those chosen to participate. On the other 
half, which was an addressed postcard, the students indicated 
whether they would like to be considered as a possible parti- 
cipant and were asked to give their local address from March 
through May. They were instructed to tear off this part and 
mail it. Almost all cards were returned indicating a willing- 
ness to participate. From these cards a random sample was 
selected, stratified by sex and major. ’ In addition, five 
students were selected' who had been classified as members of 
minority groups on campus. 

G. Selected parents, at two institutions, of the students parti- 
cipating in the study. At these two institutions, the student 
was asked to give the name and address of one of his parents 




;nt selected to 



on the postcard that was returned. If a studij 

i 

participate in the study had given the name alid address of a 
parent, that parent v;as included. Of the 111 students selected 
at these two institutions, 103 gave the name of a parent. 

H. Prepared a cover letter for each president's signature. This 

letter accompanied the first questionnaire and indicated the 

* 

presidents support of the study. 

Sr 

I. I repared a cover letter signed by the project director . This 
letter also accompanied the first questionnaire and explained 
the purposes of the study. Letters with different emphases 
were prepared for different groups. Each letter had a personal 
heading. 

J. Prepared follow-up letter for those not returning questionnaire 
within five days. 

K. Conducted a pilot study to test feasibility of using separate 
optical scan answer sheet. Results were negative. 

L. Prepared instructions to accompany the first questionnaire. 

M. Ordered envelopes for use in mailing and returning questionnaires 
and for follow-ups. 

February, 1970 

A. A printer made copies of the IGI. 

B. A commercial letter service was employed to: 

1. make copies of the president's letter 

2. prepare the letters referred to in (III.I.) uboye, with an 
autotypewriter, typing in manually the personal headings and 
greeting on each letter 

3. make mailing labels for all mailings including follow-up 
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letters 

4. collate copies of the IGI 

5. make copies of the follow-up letter 

6. prepare return envelopes (address and correct postage) 

7. pack envelopes with IGI and instructions for the first question 
naire, president’s letter, ETS letter for that group, and returi 
envelope 

8. mail envelopes to participants in order that they would be 
received on or before 1 March 

C. Commercial letter service operation was supervised by research 
assistant . 

D. Every envelope was checked for correct contents and address 
before mailing. 

E. Operational plans for processing returned questionnaires were 
set up, to include: 

1. checking on a master list the return of a questionnaire 

in order that at the end of each day it >;ould be known who 
had and had not returned one 

2. writing a preassigned identification number on the first two 
pages of each questionnaire 

3. keeping the questionnaires for the five schools separate 

4. removing the first page, which included the individual’s name, 
from each questionnaire to ensure anonymity of responses 

(The identification number which was placed on second page in- 
cluded all data given on first page except name, in addition 
to coding the school, the response group, sex, individual 
code, and questionnaire number.) 

116 
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5. mailing follow-up letters to all participants whose 
questionnaire had not been received by 6 March 

6. coding responses to each goal statement from 1 to 5 in the 
space provided in the margin of the questionnaire to assist 
keypunchers 

7. arranging for local keypunching service to keypunch and 
verify 1000 questionnaires in 24-hour period 

8. reading comments and examining added goals 

9. writing and testing computer program to calculate number of 
respondents per group and to calculate modes in an output 
format which could be easily used by the printer in preparing 
the feedback for the next questionnaire 

10. arranging with the printer for printing the second question- 
naire 

11. preparing the instructions for the second questionnaire 
after having reviewed returns of first questionnaire 



V. March, 1970 

A. Followed above plan (IV. E.) for processing first questionnaires, 

B. Repeated steps (IV. A.) through (IV. D.) for the second questionnaire 
with the following modifications. 

1. The president’s and ETS’s cover letters were not included. 

2. The packets were mailed to participants in order that they 
would be received on or before 1 April and a follow-up letter 
was mailed on 4 April. 

C. The operational plan for processing the second questionnaire was 
the same as given in (IV. E.) except for the following. 

1. Arrangements were made for all minority comments to be recorded 
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and then summarized for each goal statement separately for 
"IS" and "SHOULD BE" and separately for each school. Plans 
were made for tliree research assistants working full time for 
/ 10 days to record the goal comments while the project director 

and one research assistant summarized the comments for use 
on the third questionnaire. 

2. Arrangements were made to provide the feedback of these 
comments for each goal statement separately for "IS" and 
"SHOULD BE", as well as placing the comments under the head- 
ings, "More Important Than the Average Response" and "Less 
Important Than the Average Response." The design of the sum- 
maries was to provide feedback which could be easily lined up 
with the IGI (matching comments with the appropriate goal 
statement) . 

VI. April, 1970 

A. Followed above plan (V.B.) for processing second questionnaire. 

B. Repeated (V.B.) for the third questionnaire with die following 
modifications . 

1. The president's cover letter was included. 

2, The packets were mailed on or before 1 Ma; r id a follow-up 
letter was mailed on 6 May. 

C. The operational plan for processing the third ^ 'rtionnaire was 
the same as given in (IV. E.) with the exception that this was the 
last questionnaire. 

VII. May, 1970 

A. Followed above plan (VI. C.) for processing third question- 
naire. 
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VIII. June, July, August, 1970 

A. Set up disc and tape files. 

B. Analyzed data for reports to institutions. 

C. Developed computer programs to assist in (VIII. B.) with printouts 

that could be used directly in the reports. 

D. Developed report for each institution which included: 

1. the number of participants completing the questionnaire 
by group 

2. a profile of the present and preferred importance given to 
each goal area 

3. a comparison of their present and preferred profiles with 
those of the other participating institutions 

4. the mean and standard deviation of the present and preferred 
importance of each goal area and of each goal statement by 
response group and by all respondents for each questionnaire 

5. a ranking of goal areas and goal statements according to 
their present and preferred importance by response group and 
by all respondents 

6. a ranking of goal areas and goal statements according to the 
magnitude of discrepancy between present and preferred 
importance by response group and by all respondents 

7. a plot for each goal area indicating each group f s mean im- 
portance rating for each questionnaire. This usually indicates 
whether convergence occurs. 

8. the same analyses (VIII ,D. 1 . -7. ) performed for all institutions 
combined 
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IX. 



X. 



September, October, 1970 

A. Met with liaison personnel to explain results. 

B. Set schedule for visits at each institution to explain results 
to president and others. 

C. Determined visiting team. 

1. ETS representatives 

2. RELGV representatives 

3. Consultant 

November, December, 1970; January, February, 1971 

A. Analyzed data for final report. 

B. Prepared final report for review by ETS and RELCV . 

C. Revised final report on the basis of the review. 

D. Prepared an article for publication. 
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CORRELATIONS AMONG GOAL AREAS FOR ALL INSTITUTIONS 
BASED UPON DATA COLLECTED FROM QUESTIONNAIRE 3 
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SUMMARY 

Black undergraduates at the University of Maryland, College Pjrk who 
registered for the fall 1969 term and who did not register for the spring 
1970 term were compared with Blacks who did register for both terms on 29 
demographic and attitudlnal items from the University Student Census (USC) . 
Thirteen percent of the Blacks were non-returnees , compared to 15% of all 
undergraduates. Results indicated that the Blacks who return to their studi 
at the University have more self confidence and higher expectations (Tables 
4 and 5), feel more strongly that the University should influence social con 
ditions (item 34, page 5), see more racism at the University (Table 3) and 
are more likely to live on campus and make use of its facilities (Table 2 
and item 42, page 5), tha- do non-retu rn i ng Blacks. 

In other words, it could be that the Blacks who stay in school have a 
strong self concept and take a more realistic look at the University and 
adapt to it to achieve their own goals.. The importance of such variables 
has been noted by several other writers. 
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Despite the publicity and the apparent interest of the predominantly 
white universities in enrolling Black students, very few Blacks are enter- 
ing these schools. In the fall of 1969 the median percent of Black freshmen 
in large, predominantly white institutions nationally was 3 % (Sedlacek and 
Brooks, 1970). Given that there are few Blacks in attendance at such schools, 
what variables are related to Blacks staying in these institutions? Evidence 
is virtually unavailable on this point. Generally there is a shortage of data 
available on variables associated with the success or failure of Black students. 
Katz (1969, p. 23) summarized it as follows: "Psychologist-.' have contributed 

little to the understanding of the motivational problems of disadvantaged 
students. Scientific knowledge has barely advanced beyond the conventional 
wisdom of the teachers 1 lounge. In a sense, so few good data are available 
that virtually any competent foray into the area is bound to be fruitful." 

It is the purpose of this study to provide some data in this area. 

The prediction of collegiate performance and attrition of students in 
general has been the subject of extensive research in the past. Despite 
this fact, it has been observed (Travers, 1949, and Stein, 1963) that there 
has been little increase in the effectiveness of prediction since 1940. To 
meet this need for more predictive effectiveness, the direction of research 
has moved into the area of socioeconomic and nonintellectual variables as 
predictors of collegiate performance and attrition (Summerski 1 1 , 1962; Stein, 
1963; Atkinson, 1964; Katz, 1964; Pettigrew, 1964; pervin, Reik, and Dalrymple, 
1966; Cope, 1968; and Reed, 1968). 

The present study developed from an interest in relating some of these 
non-intellectual and socioeconomic factors to Black student attrition. For 
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purposes of this study, "returnees" will be defined as those Black students 
at the University of Maryland (College Park) who registered for both the Fall 
1969 and Spring 1970 semester. "Non-returnees" are those Black students who 
registered for the Fall 1969 semester but not for the Spring 1970 semester at 
the Uni versi ty (excluding graduates in January, 1970). 

Specifically, the purpose of this study is to explore the ways, if any, 
in which Black returning students are different from those not returning, on 
demographic and attitudinal variables. 

Method 

Data for this study were collected from the University Student Census" 

(USC) that was administered to nearly all full-time undergraduate students (9 
credits or more) registering for the Fall 1969 semester. The sample used in 
this research was limited to all full-time Black undergraduate students who 
registered for the 1969-70 Fall and Spring semesters, and who completed the USC. 
The sample consisted of 500 Black students from a total of 582 Black under- 
graduates. Of the 82 students not included in the study, it is estimated that 
about 80 percent registered late and therefore did not take the USC. The 
research sample of 500 was divided into five student status groups: (1) New 

freshmen; (2) New transfer students; (3) Transfer students in an earlier 
semester; (4) Started as a new freshman at College Pa'k in an earlier semester, 
and (5) An "other" category. A percentage breakdown on these five categories 

of student status by sex is given in Table 1. 

Differences among groups on the first twenty-nine USC items were deter- 
mined using chi-square. On the last 17 USC questions, the subjects were asked 



* Available from the writers on request. 



to indicate the extent to which they agreed with certain statements on a 
five point scale and t-tests were employed to determine significance. 

Comparisons were made of returnees and non-returnees by total group and within 
sex. 



Resul ts 

A significant chi-square (.05 level) was found on only four of the first 
twenty-nine (JSC questions (see Tables 2 through 5) • With the exception of 
these four questions, a great deal of similarity existed between returnees 
and non-returnees. 

The first (JSC item of significance was number 4: the amount of impact 

the Student Course Guides had upon the student*s course selection. There was 
a significant difference found at the .05 level when all returnees were com- 
pared to all non- retu rnees and when female returnees were compared to female 
non-returnees (see Table 2). The greatest difference indicated in Table 2 
is that while only 19% of the returning students declared the Student Course 
Guide had no impact upon their course selection, 34% of all non-returnees 
felt it had no impact. Although results were not significant, differences 
between male returnees and non-returnees were similar to those for the first 
two comparisons (i.e., for the no impact reponse, 18% of male returnees as 
opposed to 31 % of the male non-returnees). 

(JSC item 10, which asks the student why he feels there are few Black 
students at the University of Maryland, had a significant chi-square beyond 
the .05 level for all returnees vs. all non-returnees (see Table 3). Returnees 
felt more (67%) that racism was the reason Blacks did not attend the University 

* The Student Course Guide is an evaluation of courses and instructors 
prepared by students. 
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compared to 47% of the non-returnees. 

A significant difference beyond the .05 level was found on item 16 for 
the female returnees versus non-returnees (see Table 4). This item asks the 
student how much education he expects to get in his lifetime. The possible 
responses were combined to give results indicating: college but less than a 

bachelor's degree; a BA or equivalent; or one or more years of graduate work. 

In percentage terms, the most striking difference between female returnees and 
non-returnees was that 56% of the non-returnees expected to get a BA or less, 
and only 32% of the returnees made this response . In addition, while 35% of 
the female non-returnees indicated that they expected to complete one or more 
years of graduate school , 62% of the female returnees made this response. 

The chi-square on (JSC item 21 showed a significant difference beyond .05 
for all returnees versus all non-returnees; and for female returnees versus 
female non-returnees (see Table 5). This item is concerned with the most likely 
reason for the student's leaving before earning a degree. The most notable 
response difference was to the option "Absolutely certain l will obtain a 
degree;" 23 % of all returning students (as opposed to 9% of all non-returning) 
gave this reply. Nineteen percent of the female returnees said they were 
absolutely certain of obtaining a degree; while only 5% of the female non- 
returnees made this choice. 

On item 23 of the (JSC, the respondent is asked where he will live during 
that semester. Of the possible answers, 49% of the female returnees indicated 
that they would be living in a University residence hall, compared to 26% of 
the female non-returnees. 

None of the comparisons between male returnees and male non-returnees 
on any of the first 29 USC items was significant. 
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The results of t-tests for all groups tested on the final seventeen 
items were in general not significant. However, four comparisons out of 
the total were significant beyond the .05 level. item 34, which states 
that the University should use its influence to improve social conditions 
in the State, was found to be significant beyond the .05 level for all three 
group combinations. In each case, returnees were more In agreement with the 
statement than non-returnees. For item 42, the data suggest that female return- 
ees felt more strongly than female non-returnees that many facilities and 
opportunities exist on campus for individual creative activities (.05 level). 

Di scuss i on 

It was hypothesized that significant differences would be found between 
returning and non-returning Black students on a number of demographic and 
attitudinal variables. Generally returnees and non-returnees appeared similar 
on the variables examined in this study. However, there were some interesting 
differences between the two groups. 

The picture which emerges is that the Blacks who returned to their 
studies at the University have more self confidence and higher expectations 
(Tables 4 & 5), feel more strongly that the University should influence social 
conditions (item 34. page 5), see more racism at the University (Table 3) and 
are more likely to live on campus and make use of its facilities (Table 2, and 
item 42, page 5) than do non-returning Blacks. 

in other words, it could be that the slacks who stay in school have a 
strong self concept and take a more realistic look at the University and adapt 
to it to achieve their own goals. The importance of such variables has been 
noticed by several other writers. Pfeifer and Sedlacek (1970) found that 
O 
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self concept was an important variable in the success of Black students at 
the University of Maryland using grades as a criterion. Epps ( 1 969 ) and 
Gurin, Lao and Beattie ( 1 969 ) found that successful Black students tended to 
have high aspirations and feel that they had control over their lives. 

The attrition figures for Blacks in this study (non- returnees , Spring 
semester) were 13% overall (10% males and 16% females). These figures com- 
pare with about 15%* for all College Park undergraduates in 1 969 (non-return- 
ees, Spring semester),. 

Several potential limitations of the study should be noted. Of course, 
the sample was drawn from a single university and only one definition of 
attrition was used. It may be that the results would be different in other 
samples or with different definitions of attrition (e.g. students leaving 
after a year or more, or those with low grades). However, students who leave 
in midyear may be an important group to examine; they may be more likely to have 
problems in adjusting to the University (e.g. expecting less racism than they 
found) and it may be possible to help or work with such students or, even 
better, to eliminate racism at the University. 

Another methodological point is that the number of comparisons made 
increases the chances of a Type 1 error. This was not considered a major 
problem since the purpose of the study was to identify variables which de- 
served further study. Thus this study should be replicated and further 
ref i ned. 

* Source: Office of Institutional Research, University of Maryland. 
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Percentage Distribution of Black Students by Class 
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fr Percentages may not equal 100 because of rounding. 



Percentage Response* for Black Students to Item 4 of the University Student Census 
(What impact has the Student Course Guide had on your course selection?) 
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(Significant differences beyond .05 using X z are AxB and CxD) 



Percentage Response* for Black Students to Item 10 of the University Student Census 
(What is the main reason you feel there are few Black students at the University of Maryland?) 
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Percentage Response* for Black Students to Item 16 of the University Student Census 
(How much education do you expect to get in your lifetime?) 
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